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ABSTRACT 


The  TETAM  Model  Verification  study  is  reported  in  three 
volumes  describing  the  validation  of  three  high  resolution 
combat  simulation  models  (DYNTACS,  lUA,  and  CARMONETTE)  using 
field  data  collected  by  US  Army  Combat  Developments  Experimenta- 
tion Command  during  Experiment  11.8.  Volumes  I and  II  contain 
an  intervisibility  study  describing  the  abilities  of  the  DYNTACS, 
lUA,  and  CARMONETTE  terrain  processors  to  predict  line-of-sight 
occurrences  between  tanks  and  antitank  missile  positions. 

Volume  III  contains  a validation  study  of  the  engagement  processors 
of  DYNTACS  and  lUA.  The  results  from  the  simulation  models  in 
terms  of  firings,  engagements,  and  losses  between  tank  and  antitank 
as  compared  with  the  field  data  collected  during  the  free  play 
battles  of  Field  Experiment  11.8  are  found  in  Volume  III. 
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EXECUTIVE  SUMMARY 

1.  INTRODUCTION.  The  Tactical  Effectiveness  Testing  of  Ai.titank  Missiles 

(TETAM)  program,  originated  in  December  1970  by  Department  of  Defense 
Program  Budget  Decision  464,  consists  of  three  major  elements:  a field 

experiment  conducted  by  Combat  Developments  Experimentation  Command  (CDEC) 
in  1972-73,  a detailed  evaluation  of  the  effectiveness  of  US  antitank  mis- 
sile weapons  based  primarily  upon  data  collected  during  the  field  experi- 
ment, and  an  evaluation  of  the  predictive  abilities  of  three  of  the  Anty's 
frequently  used  high  resolution  simulation  models  of  tank-antitank  warfare 
using  the  results  of  the  field  experiment  as  a baseline.  Progress  on  this 
third  major  element  of  the  TETAM  program,  the  Model  Verification  Study,  is 
the  subject  of  this  report. 

2.  PURPOSE.  The  purpose  of  the  Model  Verification  Study  is  to  determine 
the  ability  of  the  DYNTACS,  CARMOflETTE,  and  Individual  Unit  Action  (lUA) 
high  resolution  combat  simulations  to: 

d.  Predict  the  outcomes  of  selected  tank-antitank  battles  conducted 
(simulated)  during  the  CDEC  Experiment  11.8. 

b.  Represent  the  major 'battlefield  activities  and  processes  leading 
to  these  outcomes. 

3.  SEQUENTIAL  STUDY.  Each  of  the  three  models  is  designed  to  simulate 
the  conduct  of  tank-antitank  battles  by  playing  in  detail  the  fundamental 
battlefield  activities  of  participating  personnel  and  weapon  systems  and 
the  environment  within  which  these  activities  occur.  These  fundamental 
activities  include  but  are  not  limited  to  the  search  for,  detection, 
recognition,  and  identification  of  targets  on  the  battlefield;  the  loading, 
laying,  and  firing  of  antitank  weapons;  and  the  process  of  guiding  antitank 
missiles  on  their  intended  targets.  For  any  given  weapon  crew,  these  ac- 
tivities often  occur  in  well  defined  sequences.  Witnin  a given  sequence, 
the  occurrence  of  one  activity  is  normally  dependent  upon  the  previous  occur- 
rence of  the  preceding  activities;  and  most  of  these  fundamental  activities 
are  either  directly  or  indirectly  conditional  upon  the  existence  of  line  of 
sight  (intervisibility).  A sequential  approach  to  the  study  was  appropriate, 
and  a comprehensive  evaluation  of  each  model's  ability  to  represent  accu- 
rately intervisibility  between  attacker  and  defender  elements  on  the  battle- 
field was  detennined  to  be  a necessary  first  step  in  this  sequence. 

4.  OBJECTIVE,  The  specific  objective  of  the  intervisibility  study  was 
to  determine  whether  the  three  models  provide  an  accurate  representation 
of  intervisibility  between  attacking  armored  elements  and  defending  anti- 
tank missile  systems. 

b.  CONCEPT.  The  concept  for  accomplishing  the  intervisibility  study  was 
founded  on  three  salient  features. 
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a.  The  i eld  experiment  is  the  baseline  against  which  model  perform- 
ance Is  evaluated.  Thus,  the  models  art  set  up  and  run  under  conditions 
as  close  as  possible  to  those  of  the  field  experiment;  and  results  from 
the  models  are  compared  to  those  of  the  field  experiment. 

b.  Comparisons  of  model  and  field  experiment  results  are  made  In 
terms  of  fundamental  variables  rather  than  aggregated  or  abstracted  mea- 
sures wherever  possible. 

c.  MS  outlined  above,  model  verification  is  acromplished  through  an 
orderly  and  sequential  process  so  that  causes  of  differ'ences  between  models 
and  the  field  experiment  can  be  isolated,  identified,  and.  If  appropriate, 
resolved. 

6.  FIELD  EXPERIMENT  DATA.  One  of  the  objectives  of  CDEC  Experiment  11.8 
was  to  collect  data  suitable  for  use  in  model  verification. 

a.  Phase  I,  CDEC  Experiment  11.8,  conducted  March  through  December 
1972,  collected  data  on  the  frequency  and  duration  of  intervisibility 
between  defensively  emplaced  antitank  missile  weapons  and  advancing  eneiqy 
armored  vehicles  for  12  sites  in  Viest  Germany,  2 sites  at  Fort  Lewis, 
Washington,  and  2 sites  at  Hunter-Liggett  Military  Reservation,  California. 
Thus,  a considerable  amount  of  detailed  intervisibility  data  were  avail- 
able from  the  field  experiment  for  use  as  a standard  against  which  to 
evaluate  model  performance. 

b.  The  Intervisibility  data  collected  at  Hunter-Liggett  were  selected 
for  use  in  evaluating  model  performance  because  all  data  other  than  the 
intervisibility  data  produced  by  Experiment  11.8  were  collected  only  on 
the  Hunter-Liggett  experimentation  sites.  These  Hunter-Liggett  Inter- 
visibility data  were  collected  during  September  and  October  1972  on  two 
partially  overlapping  2x5  kilometer  terrain  sites,  the  characteristics  of 
which  were  distinctly  different.  Thus,  Hunter-Liggett  field  data  were 
available  for  an  evaluation  of  model  performance  in  two  diverse  terrain 
environments.  Two  sets  of  data  for  different  sets  of  approach  routes 
were  collected  on  one  of  these  sites,  thus  providing  three  sets  of  Inter- 
visibility data  for  comparisons. 

7.  MODEL  PREPARATION  AND  OPERATION. 

a.  Preparation.  As  the  data  collected  during  the  intervisibility 
field  experWnt  provided  the  baseline  against  which  model  performance 
was  to  be  evaluated,  it  was  necessary  to  reproduce  in  the  models  condi- 
tions as  close  as  possible  to  those  of  the  field  experiment.  Thus,  the 
design  and  conduct  of  the  intervisibility  field  experiment  provided  the 
foundation  upon  which  the  model  preparation  work  was  based.  Specific 
policies  governing  model  preparation  were  designed  to  produce  (1)  Inter- 
visibility data  for  conditions  similar  to  those  of  the  field  experiment, 
and  (2)  model  results  that  could  be  considered  generally  representative 
of  model  capabilities  in  typical  applications.  The  DYNTACS(X)  and  lUA 
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models  were  prepared  and  operated  by  members  of  the  study  team  at  CACDA. 
Preparation  and  operation  of  the  CARMONETTE  VI  model  was  accomplished  at 
Concepts  Analysis  Agency  under  direction  provided  by  the  CACDA  study  team. 
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b.  Uperation . A plan  for  running  the  three  models  was  developed 
calling  for  three  basic  runs  of  each  model,  one  for  each  of  the  three 
field  trails  that  produced  the  Hunter-Liggett  intervisibility  data.  These 
model  runs  were  performed,  and  model  results  were  compared  to  correspond- 
ing results  from  the  field  experiment.  Several  supplementary  runs  were 
also  made  in  an  effort  to  investigate  specific  questions  related  to 
unique  design  features  of  the  DYMTACS  and  lUA  models.  These  basic  and 
supplementary  model  runs  provided  the  data  necessary  for  evaluating  model 
performance . 

8.  ANALYSIS  OF  RESULTS,  ^iodel  performance  was  evaluated  in  three  dif- 
ferent ways.  First,  several  different  methods  v^re  used  to  compare  field 
experiment  results  to  the  results  produced  by  each  model.  Additionally, 
the  results  produced  by  each  model  were  compared  to  those  from  each  of 
the  other  two  models,  ."inally,  a limited  amount  of  sensitivity  testing 
of  the  models  was  undertaken  in  an  effort  to  provide  insights  into  model 
validity. 

9.  PRINCIPAL  FINDINGS  AND  INTERPRETATION. 

a.  The  various  model  and  field  data  comparisons  provided  the  follow- 
ing findings: 

(1)  Model  and  field  results  were  markedly  different  for  all  three 
sets  of  field  conditions.  The  models  exhibited  a general  tendency  to  de- 
pict the  sites  studied  as  being  more  favorable  to  target  acquisition  and 
engagement  than  was  reported  in  the  field  experiment. 

(2)  In  one  case  (lUA  in  the  more  cluttered  terrain  site),  model 
performance  was  highly  erratic  and  exhibited  no  decipherable  pattern  of 
disagreement  with  field  results.  In  the  other  cases,  several  general 
trends  were  observed: 

(a)  For  a given  defender  position  and  500-meter  portion  of 
an  attacker  approach  route,  the  models  tended  either  to  agree  closely  or 
to  disagree  widely  with  field  results.  The  two  cases  appear  equally 
likely,  each  occurring  about  40  percent  of  the  t.me. 

(b)  The  model  and  field  data  agreement  areas  are  likely  to 
be  areas  where  the  field  data  indicate  that  either  none  or  nearly  all  of 
an  approach  route  segmer*  can  be  seen  from  the  defender  positions. 

(c)  In  areas  of  disagreement,  the  models  tend  to  indicate 
more  intervisibility  than  was  recorded  in  the  field. 
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(d)  The  models  indicate  that  changes  in  weapon  height  ►’ave 
a mucn  more  pronounced  effect  on  Intervisibility  levels  than  is  indicated 
in  the  field  data. 

(3)  Although  similarities  exist,  serious  differences  atiwng  the 
models  are  obvious. 

b.  Review  of  the  experimental  procedures  leads  to  some  questions  as 
to  the  quality  of  the  experimental  data.  This,  in  turn,  limits  the 
ability  to  Interpret  the  findings  cited  above.  Even  taking  into  consid- 
eration the  possible  limitations  of  the  experimental  data,  the  extent  of 
model  and  field  disagreement,  when  combined  with  the  disagreement  among 
models  themselves,  must  indicate  a serious  model  problem.  The  specific 
source  of  the  problem,  however,  is  not  known;  and  the  models  and  model 
data,  field  experiment  data,  and  comparison  approach  followed  are  all 
potentially  contributing.  Thus,  further  study  to  define  more  clearly 
and  rectify  the  problem  appears  Indicated. 

10.  CONCLUSIONS. 

a.  Major  differences  exist  between  intervisibility  levels  and  pat- 
terns produced  by  the  three  combat  models  and  those  recorded  in  the  inter- 
visibility field  experiment. 

b.  The  general  lack  of  close  agreement  be'^ween  results  from  any  two 
models  indicates  diverse  model  problems. 

c.  In  light  of  the  magnitude  of  differences  observed,  it  is  clear 
that  these  differences  must  be  resolved  before  proceeding  to  investiga- 
tion of  model  representation  of  battlefield  activities  that  are  contin- 
gent upon  Intervisibility. 

11.  FOLLOW-ON  ACTIONS.  The  findings  of  the  original  intervisibility 
comparisons  led  to  additional  work  in  the  area  oriented  toward  explain- 
ing the  observed  model  and  field  differences  and  correcting  model  de- 
ficiencies, at  least  to  a sufficient  degree  to  permit  reasonable  investi- 
gation of  other  intervisibility-dependent  battlefield  activities.  The 
follow-on  work  is  reported  in  Volume  II  of  the  TETAM  Model  Verification 
Study  Report. 

12.  SUMMARY.  The  first  phase  of  model  verification,  the  initial  evalua- 
tion of  the  models'  ability  to  represent  accurately  Intervisibility  be- 
tween attacking  and  defending  ground  weapons,  has  been  completed.  Because 
several  concerns  related  to  the  reliability  of  field  experiment  data  were 
identified,  study  findings  and  conclusions  must  be  considered  tentative 
until  each  of  these  concerns  is  investigated.  However,  study  results 
generally  substantiate  widely  held  concerns  regarding  the  reliability  of 
results  produced  by  high  resolution  models  of  combat  and  indicate  that 
continued  emphasis  in  the  field  of  model  validation  is  essential.  Even 
so,  study  results  should  be  viewed  as  encouraging  in  that  direction  for 
improvements  in  model  performance  are  being  established. 
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CHAPTER  I 


INTRODUCTIOU 

’.-1.  BACKGROUND.  The  Tactical  Effectiveness  Testing  of  Antitank  Missiles 
(TETAM)  program  was  originated  in  December  1970  by  Department  of  Defense 
Program  Budget  Decision  464.  As  originally  defined,  the  program  contained 
two  major  elements.  Field  Experiment  11.8  was  conducted  by  ibie  Combat 
Developments  Experimentation  Command  (CDEC)  in  1972-73  (reference  1).  A 
detailed  evaluation  of  the  effectiveness  of  US  antitank  missile  weapons 
based  primarily  upon  data  collected  during  Experiment  11.8  was  conducted 
by  the  US  Army  Combined  Arms  Combat  Developments  Activity  (CACDA)  in  1973- 
74  (reference  2).  In  1972,  Department  of  the  Army  added  a third  major 
element  to  the  TETAM  program,  that  of  evaluating  the  predictive  ability  of 
three  of  the  Army's  frequently  used  h'»qh  resolution  simulation  models  of 
tank-antitank  warfare,  using  the  results  of  Experiment  11.8  as  a basis  for 
evaluation.  The  resulting  Model  Verification  Study  was  conducted  by  CACDA 
during  the  period  October  1973  to  October  1975. 

1-2.  OVERVIEW  or  THE  MODEL  VERIFICATION  STUDY. 

*•  Purpose  and  Objectives . The  purpose  of  the  Model  Verification 
Study  is  to  determine ’the  ability  of  the  DYNTACS,  CARMONETTE,  and  Individ- 
ual Unit  Action  (lUA)  high  resolution  combat  simulations  to  portray  the 
outcomes  of  selected  tank-antitank  battles  as  carried  out  during  CDEC 
Experiment  11.8  and  to  represent  the  major  battlefield  activities  and 
processes  leading  to  these  outcomes.  The  specific  objectives  are: 

(1)  Determine  the  ability  of  each  model  to  portray  the  outcome 
of  Experiment  11.8  tank-antitank  battles. 

(2)  Determine  the  degree  of  correlation  between  Experiment  11.3 
and  each  model  in  portraying  the  following  aspects  of  tar k-antitank  battles: 

(a)  Attacker-defender  intervisibility. 

(b)  Movement  of  attacking  forces. 

(c)  Target  acquisition. 

(d)  Target  handoff. 

(e)  Target  assignment. 

(f)  Target  engagement/kill . 

(g)  Combat  intelligence. 

(h)  Communications. 

(i)  Supporting  fires. 
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(The  list  of  battle  aspects  to  be  consitiered  varied  during  the  course  of 
the  study.  All  items  shown  were  identified  as  candidates  for  comparisons 
at  one  time  or  another  during  the  study.) 

(3)  Identify  the  major  underlying  assumptions  relevant  to  tank- 
antitank  battles  for  each  model. 

(4)  Identify  and,  where  possible,  prioritize  needed  modifications 
and/or  improvements  for  each  model . 

b . Historical  Narrative. 

(1)  Preliminary  stages. 

(a)  Planning.  Resporsibility  for  accomplishing  the  Model 
Verification  Study  was  initially  assigned  to  the  Systems  Analysis  Group 
(SAG)  of  the  US  Army  Combat  Developments  Command.  SAG  had  formulated  a 
general  approach  to  the  model  verification  work  by  March  1973.  At  that 
time,  as  part  of  the  1973  reorganization  of  the  US  Army,  responsibility 
for  the  study  was  transferred  to  CACDA.  CACDA  expanded  this  general 
approach  into  a specific  concept  for  model  verification,  which  was  pre- 
sented to  the  TETAM  Senior  Officer  In-Process  Review  on  20  June  1973 
(reference  3).  This  concept  called  for  a sequential  approach  to  model 
verification  to  begin  with  verification  of  each  model 's  representation 
of  intervisibility,  followed  by  analysis  of  each  model's  play  of  detec- 
tion end,  finally,  by  an  investigation  of  the  weapon  interactions  in 
dynamic,  force-on-force  engagements.  This  approach  followed  the  same 
general  sequence  established  within  the  three  major  phases  of  CDEC 
Experiment  11.8.  As  illustrated  in  figure  1-1,  each  step  was  to  involve 
a comparison  of  model  and  field  results,  determination  of  sources  of 
observed  differences,  and  corrective  actions  necessary  to  continue  the 
process . 


(b)  Preparation.  Of  the  three  models  to  be  evaluated,  one 
(lUA)  was  the  responsibility  of  CACDA  from  the  outset  of  the  study. 
Responsibility  for  a second  model  (DYNTACS)  was  transferred  from  SAG  to 
CACDA  in  July  1973.  This  transfer  did  not  include  the  transfer  of  per- 
sonnel familiar  with  the  model,  and  a program  of  formal  training  on  the 
setup  and  operation  of  DYiNTACS  was  conducted  for  CACDA  prograimers  and 
analysts  in  November  and  December  1973  (reference  4).  US  Army  Concepts 
Analysis  Agency  (CAA)  agreed  to  operate  the  third  model  (CAPMOMETTE)  in 
support  of  the  model  verification  work.  By  mid-January  1974,  all  three 
models  were  being  operated  in  support  of  the  model  verification  objec- 
tives. Detailed  intervisibility  data  collected  in  the  execution  of 
Experiment  11.8  were  obtained  from  CDEC  during  the  last  quarter  of  1973 
and  were  in  a form  suitable  for  the  comparisons  in  January  1974. 


1-2 


Sequential  Nature  of  Model  Verification 


(2)  Original  intervisibility  canparisons.  The  original  com- 
parisons of  intervisibility  data  produced  by  the  three  models  with  the 
Experiment  11.8  intervisibility  data  were  conducted  during  the  period 
January  through  May  1974,  and  an  interim  report  was  published  in  June  1974, 
The  original  comparisons  were  conducted  to  determine  whether  the  models 
portrayed  intervisibility  levels  and  patterns  consistent  with  those 
observed  in  Experiment  11,8.  It  was  anticipated  that  the  level  of  dis- 
agreement between  model  and  field  results  would  be  relatively  minor  and 
that  work  could  progress  into  investigations  of  model  representation  of 
detection  and  battle  free  play  with  minimal  model  adjustments.  Contrary 
to  expectations,  model  results  were  found  to  be  in  serious  disagreement 
with  tlie  intervisibility  data  collected  during  Experiment  11.8.  The 
original  comparisons  are  contained  in  this  report. 

(3)  Approach  to  revision.  The  extreme  disagreement  between  model 
and  Experiment  11.8  realizations  of  intervisibility  dictated  that  further 
project  resources  be  expended  to  clarify  the  causes  of  this  disagreetnent 
and  to  attempt  to  improve  model  representation  of  intervisibility.  The 
study  approach  was  revised  to  permit  continued  intervisibility  work  and, 
concurrently,  to  begin  the  necessary  model  preparation  and  field  experi- 
ment review  for  the  free  play  comparisons.  The  distinct  study  phase 
dealing  with  detection  as  an  isolated  process  was  estimated  to  require  a 
resource  increment  approximately  equal  to  that  already  expended  on  the 
intervisibility  comparisons  and  was  not  amenable  to  initiation  until  the 
intervisibility  situation  had  been  resolved.  Lacking  such  resources,  the 
detection  study  phase  was  dropped  from  the  approach.  The  revised  approach 
was  approved  by  the  Model  Verification  Study  Project  Review  Board  on 

15  October  1974.  In  the  interim,  the  CAA  comnitment  to  operate  CARMONETTE 
in  support  of  the  study  had  expired,  and  the  follow-on  work  was  limited 
to  the  DYNTACS  and  lUA  models. 

(4)  Follow-on  intervisibility  comparisons.  The  second  series  of 
intervisibility  comparisons  was  conducted  during  the  period  October  1974 
to  July  1975,  with  some  preliminary  excursions  attempted  in  August  and 
September  1974.  This  effort  included  a critical  review  of  the  field 
experiment  as  well  as  significant  revisions  to  the  DYNTACS  and  lUA  repre- 
sentations of  intervisibility.  Additionally,  a terrain  representation 
model.,  which  involved  a significantly  higher  level  of  resolution  than 
that  found  in  the  combat  simulations,  was  investigated.  This  fourth 
model  is  a product  of  the  Corps  of  Engineers  Waterways  Experiment  Station 
(WES)  and  was  operated  by  WES  in  si'pport  of  the  study.  The  follow-on 
intervisibility  work  resulted  in  representations  of  intervisibility 
within  DYNTACS  and  IDA  that  were  .iudged  to  be  in  sufficient  agreement 
with  the  Experiment  11. C data  to  allow  the  study  to  progress  into  the 
dynamic  battle  comparisons.  This  work  is  reported  in  Volume  II  (refer- 
ence 5). 

(5)  Dynamic  battle  comparisons.  The  work  leading  to  and  actual 
comparisons  of  dynamic  force-on-force  battles  as  represented  in  lUA  and 
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DYMTACS  and  as  carried  out  in  Experiment  11.8  was  conducted  during  the 
period  Novemb3r  197d  to  Septetnber  1975.  A significant  portion  of  this 
effort  involved  an  ex::ensive  review  of  the  experimental  procedures  and 
data.  This  review  was  required  to  develop  a detailed  appreciation  of 
what  actually  took  place  in  the  free  play  trials  of  Experiment  11,8,  This 
review  and  a comparison  of  model  and  field  results  for  selected  battles, 
as  well  as  a critical  review  of  model  aspects  for  which  no  comparison  data 
from  Experiment  11,8  was  available,  are  reported  as  the  dynamic  battle,  or 
free  play,  portion  of  the  Model  Verification  Study  in  Volume  III  (refer- 
ence 6) . 

1-3.  PURPOSE  AND  SCOPE  OF  REPORT.  This  report  (Volume  I)  documents  the 
work  leading  to  and  presents  the  results  of  the  initial  comparisons  of 
intervisibility  as  represented  by  the  CARMONETTE , OYNTACS  , and  lUA  models 
with  the  intervisibility  data  collected  during  Phase  I of  Experiment  11.8. 
The  findings  and  conclusions  found  in  this  report  are  based  solely  on 
these  comparisons.  Proper  interpretation  of  these  findings  depends  upon 
the  results  of  both  the  follow-on  intervisibility  work  initiated  as  a 
result  of  these  findings  (reference  5)  and  the  dynamic  battle  comparisons 
(reference  6). 

1-4.  OVERVIEW  AND  REPORT  ORGANIZATION. 

a.  Study  Requirement,  Each  of  the  three  models  is  designed  to  simulate 
the  conduct  of  tank -an ti tank  battles  by  playing  in  detail  the  fundamental 
battlefield  activities  of  participating  personnel  and  weapon  systems  and 
the  environment  within  which  these  activities  occur.  A typical  set  of 
fundamental  activities  performed  by  an  antitank  weapon  crew  might  occur 

in  the  following  sequence:  search  for,  detection,  recognition,  and  iden- 

tification of  a target  on  the  battlefield  followed  by  loading,  laying, 
and  firing  the  weapon  and  guiding  the  antitank  missile  onto  the  target. 

In  the  models,  as  on  the  battlefield,  the  failure  of  a weapon  crew  to 
perform  successfully  any  one  activity  in  this  sequence  will  normally 
prevent  that  crew  from  accomplishing  the  remaining  activities  in  the 
sequence;  that  is,  whether  or  not  an  ATM  crew  undertakes  a particular 
activity  is,  in  general,  conditional  upon  success  in  the  first  activity, 
the  search  for  and  detection  of  a target.  But  detection  is  itself  con- 
ditional upon  the  opportunity  to  detect.  Within  tlie  context  of  the  small 
unit  tank-antitank  battles  of  Experiment  11  .3,  opportunities  for  detection 
are  those  instances  during  which  line  of  sight  exists  between  attacking 
and  defending  elenents.  Thus,  the  occurrence  of  each  of  the  fundamental 
activities  previously  discuss^  is  either  directly  or  indirectly  condi- 
tional upon  the  existence  of  line  of  sight.  For  this  reason,  it  was 
decided  that  a comprehensive  evaluation  of  each  model's  ability  to 
represent  accurately  the  intervisibility  conditions  on  the  battlefield 
was  a necessary  first  step  in  model  verification. 

b.  F^ujrj30S£.  The  purpose  of  the  original  intervisibility  comparisons 
was  to  determine  whether  the  three  models  predict  levels  and  patterns  of 
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intcrvisibi  Mty  between  attacking  anrioreci  elements  and  defending  antitank 
missile  systems  consistent  with  those  observed  during  the  TETAM  intervisi- 
bility field  experiments. 

c.  Approach . Intervisibility  data  collected  at  Hunter-Liggett  Military 
Reservation  Huring  Phase  lA  of  CDEC  Experiment  11.8  were  selected  as  the 
baseline  against  which  model  performance  was  to  be  evaluated.  An  examina- 
tion of  the  design  and  conduct  of  the  field  experiment  was  conducted  in 
order  to  determine  the  conditions  under  which  the  intervisibility  field 
experimentation  took  place.  The  three  models  v^ere  then  set  up  and  run 
under  conditions  as  close  as  possible  to  those  of  the  field  experiment, 

and  the  resulting  model  data  were  compared  to  those  collected  during  the 
field  experiment.  These  comparisons  resulted  in  a number  of  findings 
regarding  the  degree  of  correlation  between  model  and  field  results. 

d.  Study  Methodology.  Completion  of  the  intervisibility  study  was 
contingent  upon  the  accomplishment  of  the  five  major  tasks  shown  in  the 
schematic  at  figure  1-2.  Each  of  these  major  tasks  was  in  turn  made  up 
of  several  subtasks.  Tl\ese  major  tasks,  their  associated  subtasks,  and 
the  sections  of  this  report  in  whicn  they  are  reported  are  outlined  briefly 
below. 


(1)  Approach  fomiulation.  The  development  of  a suitable  approach 
to  model  verification  was  tne  initial  problem  to  be  solved.  The  results 
of  this  work  are  reported  in  the  TETAM  Model  Verification  Plan,  USACACDA, 

23  November  1973  (reference  3). 

(2)  Baseline  definition.  Considerable  time  and  effort  were 
expended  in  attempting  to  define  precisely  the  Experiment  11.8  baseline 
against  which  the  three  mod.als  were  to  be  evaluated.  A review  of  experi- 
mental procedures  is  at  chapter  2.  Model  comparison  work  centered  on 
resolving  three  specific  problems;  the  first  was  the  problem  of  arriving 
at  suitable  corrections  for  the  several  different  types  of  anomalies  dis- 
covered in  the  intervisibility  data  provided  by  CDEC,  the  second  was  the 
problem  of  determining  (primarily  through  an  analysis  of  the  design  and 
conduct  of  the  experiment)  the  quality  of  intervisibility  data  collected 
in  the  field,  and  the  third  was  an  attempt  to  determine  through  sensitiv- 
ity analysis  the  exte.it  to  v/hich  errors  in  the  field  data  might  limit  the 
usefulness  of  these  data  as  a definitive  comparison  baseline.  Work  re- 
lated to  the  first  of  these  tasi^s  is  reported  in  appendix  C and  the 
sensitivity  analys’s  at  appendix  B.  As  the  remaining  task  is  more 
closely  associated  with  the  interpretation  of  comparison  results,  dis- 
cussions of  this  work  are  included  in  the  report  on  the  follow-on 
intervisibility  work  (reference  5). 

(3)  Model  preparation  and  operation.  Model  preparation  included 
the  development  of  suitable  inputs  describing  field  experiment  conditions 
for  each  of  the  three  models  and  the  design  and  implementation  of  model 
modifications  so  that  appropriate  model  outputs  could  be  extracted  for  the 
comparisons.  In  addition,  a suitable  plan  for  running  the  three  models  had 
to  be  devised  and  executed.  Model  preparation  is  discussed  in  chapter  3. 
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Figure  1-2.  General  Study  Hethodology 


(4)  llfthoitol  0()v  (.lovi.'lonmcnt . Tv/o  soparat*'  typos  of  inethodolony 
woro  ijtulcr  dovolopmont  durimi  most  of  tho  study.  The  first  of  these  is 
tt  ' ovomll  study  motliodol oqy  outlined  in  tins  section.  This  task  con- 
s,  .led  of  the  identification  of  specific  tasks  to  be  performed  during  the 
sLuiv  and  the  integration  of  these  separate  components  into  a coherent 
stud;  effort.  The  socot d type  of  methodology  developed  during  the  study 
wcs  tt.'  selection  of  a suitable  set  of  procedures  for  perfoninng  the 
actual  comparisons  of  model  and  field  experiment  data.  These  comparison 
methods  are  described  in  chapter  4. 

(5)  Comparison  analysis.  The  final  task  consisted  of  actually 
cor.iparing  tho  model  and  field  experiment  data  and  identifying  ntajor  dif- 
ferences between  than.  This  work  is  described  in  chapter  5. 

(C)  Side  analyses.  Several  side  analyses  conducted  for  two  of 
the  models  are  not  explicitly  identified  in  the  study  methodology  de- 
scribed above.  However,  during  the  intervisibility  study,  certain  aspects 
of  tho  OYNTACS  and  lU.A  models  were  identified  as  requiring  further  inves- 
tigation; and  tliese  investigations  produced  results  with  implications  for 
model  verification.  The  reasons  for  conducting  these  investigations, 
which  generally  involved  limited  sensitivity  testing  of  the  models,  the 
results  obtained,  and  their  implications  are  reported  in  chapters  6 and  7. 

(7)  Study  results.  The  principal  findings  of  the  initial  inter- 
visibility comparisons  are  presented  in  the  final  chapter  of  this  report. 

In  addition  to  these  princijal  fiiidings,  a number  of  general  insights  re- 
lated to  the  preparation,  application,  and  verification  of  high-resolution 
combat  simulations  that  resulted  from  this  work  are  included  at  appendix  E. 

e.  Applicability.  Although  the  intervisibility  study  was  restricted 
to  examinTng~"expl icitly  the  DYNTACS,  CARMONETTE,  and  lUA  models,  it 
should  be  noted  that  the  Bonder  analytical  models  (Bonder  lUA  and  Air 
Cavalry  5)  share  the  lUA  preprocessor  programs  that  determine  intervisi- 
bility and  movement.  Tijus,  the  results  of  intervisibility  comparisons 
reported  here  for  IDA  are  also  applicable  to  the  Bonder  lUA  and  Air 
Cavalry  5 models. 
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THE  INTERVISIBILITY  FIELD  EXPERIMENT 

.^-1.  GENERAL.  One  of  the  objectives  of  CDEC  Experiment  11.8  was  to  col- 
lect data  suitable  for  use  in  model  verification.  Thus,  detailed  inter- 
visibility data  were  available  from  the  field  experiment  for  use  as  a 
standard  against  which  to  evaluate  model  performance. 

a.  Phase  I,  CDEC  Experiment  11.8  was  conducted  during  March  through 
December  1972  to  collect  data  on  the  frequency  and  duration  of  intervisi- 
bility between  defensively  emplaced  antitank  missile  weapons  and  advancing 
eneii\y  armored  vehicles.  These  data  were  collected  on  12  sites  in  Hest 
Germany,  2 sites  at  Fort  Lewis,  Washington,  and  2 sites  at  Hunter-Liggett 
Military  Reservation  (HLMR),  California. 

b.  The  intervisibility  data  collected  at  Hunter-Liggett  were  selected 
for  use  in  evaluating  model  performance  because  all  data  other  than  the 
intervisibility  data  produced  by  Experiment  11.8  were  collected  only  on 
the  Hunter-Liggett  experimentation  sites.  Selection  of  the  Hunter-Liggett 
sites  also  provided  an  additional  benefit.  Because  the  two  experimenta- 
tion sites  at  HLMR  overlapped,  and  because  intervisibility  data  were  col- 
lected for  two  separate  sets  of  attacker  approach  policies  on  one  of  these 
sites,  three  complete  sets  of  field  experiment  data  were  available  for  uso 
in  the  comparisons  at  a cost  of  preparing  only  one  set  of  terrain  data  for 
each  model . 

c.  A complete  description  of  the  collection  of  intervisibility  data 
av  HLMR  is  contained  in  Volume  IV,  Final  Report,  CDEC  Experiment  11.8 
(reference  Id)  and  is  not  repeated  here.  However,  a working  knowledge  of 
certain  aspects  of  that  experiment  is  necessary  for  full  understanding  of 
the  conduct  of  and  results  provided  by  this  study.  Therefore,  a suninary 
of  those  aspects  relevant  to  the  model  verification  work  is  provided  here 
for  convenience. 

2-2.  CONDUCT  OF  THE  FIELD  EXPERIMENT.  Phase  lA  (Intervisibility)  of 
Experiment  11.8  was  conducted  at  Hunter-Liggett  Military  Reservation, 
California  in  September  and  October  of  1972.  InUrvisibility  data  were 
collected  on  two  partially  overlapping  2xb  kilometer  terrain  sites,  the 
characteristics  of  which  were  distinctly  different.  Thus,  field  data  were 
produced  that  made  possible  an  evaluation  of  model  performance  in  two 
diverse  terrain  environments. 


a.  Experimentation  Sites.  On  Site  A,  a defensive  position  was  se- 
lected on  a dominant  hill  mass  overlooking  relatively  flat,  open  eneihy 
avenues  of  approach.  Site  A afforded  the  defenders  nearly  ideal  condi- 
tions for  long  range  observation  and  fires  out  to  2,500  meters  with  many 
opportunities  at  ranges  well  beyond.  The  defensive  position  on  Site  B 
was  located  on  the  floor  of  a gently  rolling  valley.  This  position  was 
only  slightly  higher  than  the  energy  avenues  of  approach  into  the  defensive 
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position  and,  for  tiiat  reason,  tlie  trees  scattered  throughout  the  site 
significantly  reduced  observation  and  fields  of  fire.  Even  so,  many 
opportunities  for  observation  and  antitank  missile  (ATM)  fires  existed 
out  to  1,500  meters  though  opportunities  beyond  that  range  were  few. 

b.  Defender  (ATM)  Positions.  Thirty-six  positions  suitable  for  use 
as  antitank  missile  systems  emplacements  were  selected  on  each  site.  A 
tricolored  panel  was  placed  on  each  position  with  three  horizontal  color 
bands  representing  the  heights  of  the  M551,  M113-mounted  TOW,  and  ground- 
mounted  TOW  (and  DRAGON). 

c.  Attacker  Routes . On  each  site,  10  attacked  approach  routes  were 
established  such  that  each  route  represented  a tactically  realistic  ap- 
proach for  armored  vehicles  assigned  the  mission  of  closing  with  the  de- 
fensive position  as  rapidly  as  possible.  An  additional  set  of  10  routes 
was  established  on  Site  A in  order  to  collect  intervisibility  data  for  a 
situation  in  which  tlie  attacking  force  would  attempt  to  take  maximum 
advantage  of  available  cover  and  concealment  en  route  to  the  objective. 
Thus,  three  separate  sets  of  intervisibility  data  were  collected  at  Hunter 
Liggett. 


Measurement  Interval.  Specific  points  from  which  intervisibility 
data  were  to  be  collected  were  established  at  intervals  of  approximately 
25  meters  along  each  of  th_*  30  routes.  These  viewing  points  were  marked 
with  stakes  driven  into  the  ground  and,  for  convenience,  are  referred  to 
as  "stakes"  throughout  this  report.  The  location  of  the  defender  weapon 
positions  and  of  selected  stakes  on  each  route  were  determined  by  the 
COEC  Range  Measuring  System  to  a stated  accuracy  of  ±5  meters  in  each 
coordinate. 

e.  Attacker  Heights.  At  each  stake,  data  collection  teams  determined 
whether  or  not  line  of  sight  existed  to  eac?<  of  the  36  defender  weapon 
positions  from  two  different  heights,  v.’hich  represented  the  heights  of  the 
driver  of  the  threat  tank  and  the  highest  point  on  the  threat  ATM  vehicle, 
respecti vely. 

f.  Height  Conib i nations.  By  recording  the  lowest  color  band  visible 
at  each  of  the  tri colored  panels  from  the  two  heights  at  each  stake,  data 
teams  were  able  to  collect  intervisibility  data  for  six  combinations  of 
attacker  and  defender  weapon  height.  In  addition,  each  team  recorded  its 
judgment  as  to  the  reason  for  nonexistence  of  line  of  sight  whenever  one 
or  more  color  bands  could  not  be  seen. 

g.  Data  Collection  Procedures.  Data  were  collected  by  two-man  teams. 
At  each  stake,  one  team  membe r de termi n ed  whether  line  of  sight  existed 

to  each  of  the  defender  panels  through  the  use  of  a telescope  (or  binocu- 
lars), a step  ladder,  and  a photograph  of  the  defensive  position  showing 
the  location  of  each  panel  i the  other  team  member  recorded  this  informa- 
tion on  specially  labeled  and  perforated  "port-a-punch"  cards.  Each  team 
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began  collecting  data  on  those  of  its  assigned  stakes  nearest  the  defensive 
position  and  then  proceeded  sequentially  along  its  assigned  path  to  those 
at  greater  ranges. 

2-3.  SUMf'lARY  OF  DATA  COLLECTED.  The  field  experiment  produced  three 
separate  sets  of  intervisiui lity  data  at  Hunter-Liggett,  one  for  each 
terrain  site-approach  tactic  combination.  Each  set  of  intervisibility 
data  contained  the  following  basic  information. 

a.  The  UTM  coordinates  of  each  defender  (ATM)  position  with  a re- 
ported accuracy  of  ±5  meters  in  the  X and  Y coordinates. 

b.  The  UTM  coordinates  of  selected  stakes  on  each  attacker  route 
(to  the  same  accuracy). 

c.  The  existence  or  nonexistence  of  line  of  sight  between  the  36 
defender  positions  and  each  of  the  1,500-2,000  stakes  for  each  of  the 
six  attacker-defender  heig>  t combinations. 

d.  The  data  collector's  recorded  judgment  as  to  the  reason  for  non- 
existence of  line  of  sight  whenever  it  did  not  exist. 

2-4.  REPORTED  QUALITY  OF  DATA  COLLECTED.  The  final  report  on  CDEC 
Experiment  11.8  (reference  Id,  appendix  A)  contains  a detailed  report 
on  the  quality  assurance  procedures  of  the  inter  visibility  field  experi- 
ment. The  salient  aspects  of  this  quality  assurance  program  are  sinma- 
rized  below. 

a.  Procedures.  Quality  control  procedures  aimed  at  insuring  that  no 
more  than  5 percent  of  the  field  experiment  data  would  be  in  error  were 
an  integral  part  of  the  design  and  conduct  of  the  experiment.  Several 
specific  facets  of  quality  control  are  of  particular  interest. 

(1)  Overlap.  Three  teams  were  assigned  to  collect  data  on  eacti 
of  the  10  paths,  with  each  team  I’sponsible  for  slightly  more  than  one- 
third  of  its  assigned  path.  This  assignment  provided  for  an  overlap  of 
21  stakes  between  each  pair  of  adjacent  data  collection  teams,  thus  pro- 
viding two  full  sets  of  intervisibility  data  for  42  of  the  stakes  on  each 
path. 


(2)  Spot  check.  An  additional  check  on  the  quality  of  the  data 
was  provided  by  a number  of  spot  checks.  Each  of  five  spot  check  teams 
collected  LOS  data  at  eight  consecutive  stakes  on  each  of  the  10  paths. 
These  teams  were  irM'.ructed  to  concentrate  their  efforts  on  portions  of 
the  paths  where  intervisibility  existed.  Spot  check  teams  collected  data 
only  as  to  the  existence  or  nonexistence  of  line  of  sight  and  only  from 
the  high  attacker  height. 

(3)  Remeasurement.  Before  data  were  accepted  from  any  data 
collection  team,  these  data  were  compared  against  those  of  the  adjacent 
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data  collection  teani(s)  to  detennine  whetner  the  team's  data  were  of  ac- 
ceptable quality.  The  criterion  for  data  acceptability  was  that  no  more 
tiian  5 percent  of  the  data  could  be  in  error.  Whenever  data  from  a team 
v/tre  determined  to  be  of  less  than  acceptable  quality,  data  for  the  por- 
tion of  the  path  to  which  that  team  had  been  assigned  were  retaken. 

Error  Estimate.  The  COEC  final  report  indicates  that  these  pro- 
cedures were  effective  in  limiting  errors  to  no  more  than  5 percent  of 
the  data  collected.  It  further  indicates  that  the  analysts  responsible 
for  inplementing  and  monitoring  these  procedures  in  the  field  felt  that 
about  2 percent  would  be  a better  estimate  of  the  amount  of  1 ine-of-sight 
data  in  error.  However,  no  formal  analysis  of  the  various  types  of  errors 
ana  the  frequency  with  which  they  orxur  in  the  intervisibility  data  is 
available. 

2-5.  JATA  PROCUREMENT.  These  field  experinent  data  were  originally  re- 
corded on  specially  labeled,  preperforated  "port-a-punch"  cards  issued 
to  the  data  collection  teams  in  the  field.  They  were  subsequently  edited, 
reformatted,  and  merged  into  a single  automated  data  base  at  CDEC.  In 
the  process,  all  but  one  set  of  observations  for  each  stake  were  purged 
from  the  data  base.  These  edited  data  were  provided  to  the  study  team 
on  punched  cards. 

2-6.  DATA  Editing.  The  study  team  found  it  desirable  to  reformat  the 
data  provided  by  COEC,  and,  in  the  process  of  accomplishing  this  revision, 
identified  several  types  of  anomalies  in  the  field  data.  As  others  may 
find  applications  for  this  CDEC  data  base  in  the  future,  a discussion  of 
the  work  performed  in  cleaning  up  these  data  problems  is  presented  in 
appendix  C.  Essentially,  the  study  team,  with  assistance  of  analysts 
from  Braddock,  Dunn  and  McDonald's  Scientific  Support  Laboratory  (BDM/SSL) 
at  Hunter-Liggett,  identified  and  implemented  corrections  to  these  data 
anomalies  which  were,  in  many  cases,  based  upon  study  team  and/or  BDM/SSL 
judgments  as  to  most  reasonable  treatment.  Although  the  extent  to  which 
these  corrections  reflect  field  experiment  reality  is  unknown,  these  data 
problems  were  confined  to  0.5  percent  of  the  data  collected  on  Site  A and 
to  about  4 oercent  of  the  data  from  Site  B. 
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CHAPTER  3 


MODEL  PREPARATION 

3-1.  GENERAL.  The  preparation  of  each  of  the  three  models  proceeded 
concurrent  with  the  preparation  of  field  experiment  data  described  pre- 
viously. The  DYNTACS(X)  and  IDA  models  were  prepared  and  operated  by 
menders  of  the  study  team  at  CACDA.  Preparation  and  operation  of  the 
CARMONETTE  VI  model  was  accomplished  at  Concepts  Analysis  Agency  based 
upon  guidance  and  direction  provided  by  the  CACDA  study  team.  The  design 
and  conduct  of  the  intervisibility  field  experiment  provided  the  founda- 
tion upon  which  all  the  model  preparation  work  was  based.  This  approach 
was  necessary  to  insure  that  line-of-sight  (LOS)  data  produced  by  the 
three  models  would  be  suitable  for  comparison  with  corresponding  data 
from  the  field  experiment.  The  various  activities  composing  the  model 
preparation  work  generally  contributed  to  the  accomplishment  of  one  of 
three  major  tasks:  (1)  the  development  and  preparation  of  model  inputs, 

(2)  the  extraction  of  the  appropriate  line-of-sight  outputs,  and  (3)  the 
integration  of  model  modifications  designed  to  make  the  procedures  for 
collecting  LOS  data  from  the  models  similar  to  those  used  in  the  field. 

The  purpose  of  this  chapter  is  to  outline  in  general  terms  hew  these 
tasks  were  accomplished. 

3-2.  DATA  DEVELOPMENT  POLICIES.  As  the  data  collected  during  the  inter- 
visibility field  experiment  provided  the  baseline  against  which  model 
performance  was  to  be  evaluated,  it  was  necessary  to  reproduce  in  the 
models  conditions  as  close  as  possible  to  those  of  the  field  experiment. 
This  approach  was  necessary  in  order  to  insure  that  deviations  from  the 
actual  field  experiment  conditions  would  not  contribute  appreciably  to 
differences  observed  between  model  and  field  experiment  results.  Thus, 
two  basic  policies  governing  the  development  of  model  inputs  were  adhered 
to  throughout  the  model  preparation  work.  First,  input  data  for  the 
^ree  models  had  to  conform  to  and  be  developed  from  those  of  the  field 
experiment  to  the  extent  possible  consistent  with  model  design.  As  stated 
previously,  comparability  of  inputs  was  necessary  in  order  to  eliminate 
inputs  as  a source  of  any  differences  between  model  and  field  experiment 
results.  However,  it  was  also  necessary  to  insure  that  model  inputs  were 
developed  in  a manner  consistent  with  each  model's  design  philosophy  so 
that  model  results  could  be  considered  representative  of  model  capabili- 
ties. The  second  policy  governing  data  development  dictated  that  whenever 
development  of  model  inputs  required  the  estimation  or  assignment  of  a 
parameter  to  which  more  than  one  value  reasonably  might  be  assigned,  a 
single  best  estimate  of  the  required  parameter  would  be  assigned  a priori 
for  the  base  case  evaluations  of  model  performance.  This  approacF  pre- 
cluded the  use  of  iterative  revision  of  input  parameters  and  was  appro- 
priate in  that  no  basis  for  revising  these  estimates  is  normally  avail- 
able to  the  model  user.  The  basic  purpose  of  these  two  policies  was  to 
guide  ^he  development  of  model  inputs  so  as  to  produce,  under  controlled 
conditions,  results  representative  of  model  performance  in  typical  appli- 
cations. 
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3”3.  liiPUT  DATA  UtVELOPMLNT.  The  inpcrtance  of  insuring  comparabi  li  ty 
of  model  and  field  experiment  inputs  was  recognized  early  enough  to 
pirmit  the  orderly  development  of  model  inputs  in  accordance  with  the  two 
policies  outlined  above.  Table  3-1  summarizes  the  principal  model  inputs 
affecting  line  of  sight  and  provides  some  indication  of  tne  extent  to 
wiiicn  the  study  team  was  successful  in  achieving  comparability  of  inputs. 
Trie  development  of  each  of  these  principal  inputs  for  the  three  models  is 
discussed  in  general  terms  below. 

a.  Terrain  Data.  Eacn  of  the  models  reouires  that  a detailed 

terrain  3Fta~base  be  developed  as  input  for  the  model.  Two  specific 
criteria  were  established  for  the  preparation  of  terrain  data  for  the 
models.  First,  terrain  data  were  to  be  developed  to  describe  as  closely 
as  possible  the  two  terrain  sites  on  wltich  the  field  experiment  was  con- 
ducted. Second,  where  similar  terrain  inputs  were  required  for  two  or 
more  models,  a common  procedure  for  developing  those  inputs  was  to  be 
used  whenever  possible.  Terrain  data  were  derived  from  several  different 
sources.  Elevation  data  for  DYilTACS  and  CARMONCTTE  were  developed  at 
Defense  Mapping  Agency  from  1:25,000  scale  military  mapshoets  using  auto- 
mated procedures.  Elevation  data  for  IDA  were  extracted  by  hand  from 
mapslieets  of  the  same  scale  and  quality.  Elevation  inputs  for  the  models 
were  developed  at  the  following  resolutions:  the  interval  between  uni- 

formly spaced  elevation  points  for  DYNTACS  was  established  at  95.25 
meters,  the  CARMOHETTE  grid  size  was  set  at  100x100  meters;  the  mean  area 
covered  by  an  lUA  triangle  was  36,800  square  meters.  Waterways  Experiment 
Station  (VIES)  provided  data  describing  the  vegetation,  soil  types,  and 
surface  roughness  of  the  Hunter-Liggett  terrain  sites.  This  information 
was  transformed  at  CACDA  onto  separate  acetate  overlays  describing  (cover 
and)  concealment,  soil  type,  and  roughness  from  which  certain  types  of 
terrain  data  for  the  models  were  then  developed.  The  vegetation  data 
provided  by  WES  did  not  provide  sufficient  information  from  which  to 
develop  values  for  all  model  parameters  (particularly  for  DYflTACS)  so 
this  information  was  supplentented  by  additional  data  collected  during 
on-site  inspection  of  the  HLMR  sites  by  members  of  the  study  team. 

b.  Attacker  Weapon  Heights.  The  two  at.  heights  from  which  data 

teams  coTTected  1 i"ne-of-sT^t  data  during  the  field  experiment  represented 
the  heights  of  the  driver  of  the  threat  tank  and  the  highest  point  on  the 
threat  ATM  vehicle,  respectively.  These  two  heights  were  input  to  all 
three  models. 


c.  Defender  'Weapon  Heights.  The  three  horizontal  color  bands  on  the 
panels  placed  at  each  defender  (ATM)  position  represented  the  heights  of 
the  M551  Sheridan,  the  TOW  mounted  on  the  M113  per'“onnel  carrier,  and  the 
ground  mounted  TOW  (or  DRAGOH)  weapon  systems.  The  actual  heights  of 
these  color  bands  were  used  as  inputs  to  all  three  models.  It  should  be 
noted  that  IDA  does  not  normally  provide  for  an  input  of  this  type.  In 
IDA,  line  of  sight  from  points  along  the  attacker  routes  is  computed  to 
only  a limited  number  of  points  (objective  points)  within  the  defensive 
position.  These  objective  points  are  placed  in  the  center  of  groups  of 
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Table  3-1.  Comparability  of  Principal  Inputs 


defender  weapons  and  if  line  of  sight  exists  from  a point  on  an  attacker 
route  to  an  objective  point,  LOS  is  assumed  to  exist  to  alj^  defenocr 
weapons  in  the  vicinity  of  the  objective  point  regardless  of  their  height. 
Thus,  the  concept  of  specific  defender  weapon  heights,  which  is  not  nor- 
mally provided  for  in  the  IDA  model,  was  introduced  artificially  for  the 
model  verification  work. 

d.  Defender  Weapon  Locations.  Even  a hasty  review  of  the  field 
experiment  data"  indicates  that  panel  location  is  a critical  factor  affect- 
ing line  of  sight.  The  field  experiment  data  contain  a number  of  cases 

in  which  intervisibility  data  recorded  for  two  panels  in  close  proximity 
are  completely  different.  For  this  reason  the  accuracy  with  which  de- 
fender weapon  locations  in  the  models  reflected  field  experiment  reality 
was  important  in  obtaining  valid  comparison  data.  The  actual  locations 
of  defender  weapons  (panels)  in  the  field  were  determined  through  the 
use  of  the  CDEC  Range  Measuring  System  at  Hunter-Liggett,  and  these 
locations  were  provided  to  the  study  team  as  10-digit  UTM  coordinates. 

These  UTM  coordinates  were  then  converted  to  model  coordinates  using  the 
standard  analytic  geometry  formulas  for  translating  and  rotating  axes. 
Difficulties  were  encountered  in  transforming  UTM  coordinates  to  the 
DYNTACS  coordinate  system  primarily  because  some  ambiguity  surrounded  the 
procedure  for  identifying  the  exact  locations  of  the  digitized  elevation 
points  provided  by  Defense  Mapping  Agency  for  use  in  DYNTACS.  This  prob- 
lem was  never  completely  resolved,  but  it  is  estimated  that  defender 
(panel)  locations  in  DYNTACS  were  typically  within  20  meters  of  the  field 
experiment  locations  reported  by  CDEC.  CARMONETTE  requires  only  that 
defender  weapons  be  located  in  tne  correct  100-meter  grid  square  and  this 
was  accomplished  without  difficulty.  While  precise  defender  locations 
can  be  provided  to  lUA,  the  model  actually  determines  intervisibility  to 
attacker  route  objective  points  and  ascribes  this  result  to  associated 
defender  weapons.  The  points  used  in  model  runs  and  associated  weapons 
are  presented  in  appendix  D. 

e.  Attacker  Routes.  It  was  also  important  to  insure  that  the  actual 
attacker  routes  established  for  the  field  experiment  would  be  followed  as 
closely  as  possible  in  the  model  runs.  This  was  necessary  so  that  inter- 
visibility data  produced  by  the  models  would  not  be  collected  for  vehicles 
traversing  essentially  different  paths  from  those  used  in  the  field  exper- 
iment. The  UTM  coordinates  of  selected  stakes  along  each  route  (typically, 
every  other  stake)  were  determined  by  the  CDEC  Range  Measuring  System 
(RMS).  These  coordinates  were  provided  to  the  study  team  in  automated 
form  as  part  of  the  field  experiment  punch  card  set.  The  coordinates  of 
those  stakes  for  which  Ipcatiops  .had  not.. been  determined  by  the  RMS  were 
established  by  the  study  team  by  linear  interpolation  from  the  position 
data  available.  Thus,  approximate  UTM  coordinates  were  available  for 

all  stakes  on  all  paths,  with  the  number  of  stakes  on  a path  ranging 
between  130  and  230,  depending  on  path  length. 
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(1)  DYNTACS.  Because  attacker  routes  are  selected  dynamically 
in  DYNTACS  based  upon  terrain  difficulty  and  the  enemy  situation  on  each 
route,  there  are  a number  of  difficulties  associated  with  restricting 
attacker  movement  to  specified  routes  In  the  DYNTACS  model.  For  this 
reason,  the  DYNTACS  llne-of-sight  routines  were  extracted  from  the  model 
and  operated  by  a specially  written  driver  routine  so  that  the  exact 
coordinates  of  each  stake  could  be  used  In  the  DYNTACS  runs.  The  pre- 
paration of  Inputs  specifying  attacker  routes  for  lUA  and  CARMONETTE, 
however,  presented  a different  problem. 

(2)  IDA.  lUA  allows  a maximum  of  30  coordinates  to  be  Input 
specifying  each  attacker  route.  Because  of  the  Importance  of  adhering 
to  the  field  experiment  routes  as  closely  as  possible.  It  was  decided 
that  these  points  describing  each  model  route  should  be  selected  through 
optimization  procedures.  The  problem  was  to  select  a subset  of  30  or 
fewer  stakes  from  the  set  of  all  stakes  on  each  route  such  that  the  total 
deviation  of  the  model  route  from  the  field  experiment  route  was  mini- 
mized. The  problem  was  formulated  as  a problem  In  dynamic  programing 
and  was  solved  on  the  computer,  thus  providing  sets  of  optimal  route 
descriptor  points  for  lUA  for  all  30  routes  used  In  the  field  experiment. 
This  procedure  is  documented  In  appendix  D. 

(3)  CARMONETTE.  Attacker  routes  for  CARMONETTE  are  specified  In 
terms  of  the  attacker's  progression  through  a series  of  adjacent  terrain 
grids.  Because  the  size  of  the  grid  was  established  at  100  meters  on 
each  side  during  the  coding  of  terrain  data,  the  specification  of  about 
30  grids  was  required  to  describe  fully  each  attacker  route.  The  sets 

of  optimum  stake  locations  previously  selected  for  lUA  were  also  found  to 
be  suitable  for  use  as  the  CARMONETTE  grid  sequences  for  each  attacker 
route. 

f.  Measurement  Intervals.  The  capability  for  controlling  through 
explicit  modeT  Inputs  tfie  frequency  with  which  line  of  sight  Is  computed 
Is  provided  for  only  in  the  DYNTACS  model.  This  problem  was  handled  In 
a different  manner  for  each  of  the  three  models. 

(1)  DYNTACS.  In  normal  applications,  users  of  DYNTACS  are  re- 
quired to  specify  by  input  the  duration  of  a movement  event  (In  seconds), 
and  line  of  sight  is  normally  computed  from  the  "current"  element  to 
every  enen\y  element  at  the  end  of  the  current  element's  movement  event. 
However,  the  operation  of  the  DYNTACS  llne-of-sight  routines  Independent 
of  other  submodels  precluded  control  of  the  frequency  of  computation 
through  the  use  of  this  feature,  and  an  alternate  procedure  had  to  be 
developed.  An  appropriate^  solution  to  this  problem  was  to  compute  line 
of  sight  from  the  locations  of  every  stake  In  the  field  experiment.  This 
approach,  of  course,  would  produce  model  results  that  are  not  necessarily 
representative  of  model  performance  in  a typical  model  application  because 
line  of  sight  Is  normally  computed  less  frequently.  Under  this  approach. 
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if  iiiodel  and  field  experiment  intervisibility  results  proved  to  be  simi- 
lar, further  analysis  would  be  necessary  to  evaluate  the  effects  of  using 
a more  representative  computational  frequency.  However,  if  these  results 
were  appreciably  different,  it  could  be  concluded  that  a different  com- 
putational frequency  was  not  likely  to  Improve  these  results. 

(2)  lUA.  No  provision  for  changing  the  frequency  with  which  LOS 
is  computed  exists  in  ILIA.  Line  of  sight  is  computed  at  every  route 
descriptor  point  and  at  30-meter  intervals  (approximately)  between  route 
descriptor  points.  For  this  reason,  the  lUA  runs  produced  about  10  per- 
cent fewer  data  points  than  were  collected  during  the  field  experiment; 
and  these  data,  though  computed  from  along  the  same  attacker  routes,  were 
seldom  computed  from  the  exact  field  experiment  stake  locations.  However, 
these  LOS  data  should  be  considered  representative  of  those  produced 

du.  ig  a typical  lUA  run. 

(3)  CARMONETTE.  The  frequency  with  which  LOS  is  computed  in 
CARMONETTE  is  specified  implicitly  when  the  grid  size  is  established 
during  the  preparation  of  terrain  data.  The  100-meter  grid  size  used 
for  the  model  runs  is  typical  of  the  terrain  resolution  used  historically 
in  CARMONETTE  study  applications.  Because  of  this  relatively  large  grid 
size,  CARMONETTE  produced  only  about  one-fourth  as  many  data  points  as 
the  field  experiment.  However,  these  data  should  also  be  considered 
representative  of  those  produced  by  and  used  during  typical  CARMONETTE 
runs 


3-4.  l iRACTION  OF  MODEL  OUTPUTS.  During  normal  model  runs,  each  of  the 
three  r ■ ils  performs  a considerable  number  of  logical  checks  and  mathe- 
matical computations  to  determine  whether  line  of  sight  exists  between 
the  pairs  of  points  on  the  battlefield  that  are  of  immediate  interest  at 
a particul  ' time  during  the  simulated  battle.  However,  the  models  do 
not  maintain  records  of  these  data  other  than  to  store  them  temporarily 
to  satis'  the  immediate  needs  for  information  of  this  type.  It  was 
therefore  necessary  to  modify  the  three  models  to  provide  for  extraction 
of  these  intervisibility  data.  To  insure  that  valid  comparisons  between 
model  and  field  data  could  be  made,  it  was  determined  that  intervisibility 
data  extracted  from  the  models  should  be  comparable  to  the  field  data  in 
three  respects.  First,  model  outputs  had  to  be  of  the  same  fundamental 
nature  as  those  collected  during  the  field  experiment.  Primarily,  model 
data  had  to  describe  whether  or  not  line  of  sight  existed  between  various 
points  on  the  battlefield.  Second,  the  intervals  along  the  attacker 
routes  at  which  these  data  were  to  be  taken  in  the  models  had  to  be  com- 
parable to  those  used  in  the  field  to  the  extent  possible  consistent  with 
model  design.  (The  extent  to  which  comparability  in  this  respect  was 
attainable  was  described  in  paragraph  3f  of  this  chapter  and  is  not  re- 
peated here.)  Finally,  it  was  necessary  to  insure  that  each  model  would 
play  all  factors  affecting  line  of  sight  in  the  field  experiment  within 
the  constraints  of  model  design.  The  extent  to  which  comparability  of 
model  outputs  was  achieved  is  outlined  below. 
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a.  Nature  of  Model  Outputs.  The  series  of  logical  checks  and  mathe- 
matical computatfons  used  by  each  of  the  three  models  are  designed  to 
produce  the  same  basic  information  as  that  collected  during  the  field 
experiment;  that  is,  they  determine  whether  line  of  sight  exists  between 
two  specific  points  on  the  battlefield.  Therefore,  the  fundamental  data 
needed  for  an  evaluation  of  each  model's  ability  to  play  line  of  sight 
were  readily  available  wi thin  the  models,  and  the  only  difficulty  presented 
was  the  technical  problem  associated  with  extracting  and  recording  these 
data.  In  addition,  each  of  the  th  ee  models  in  normal  operation  deter- 
mines, in  some  fashion,  the  degree  to  which  the  target  vehicle  is  con- 
cealed from  observation  and  direct  fires  from  the  observer  position. 

Thus,  some  data  available  within  the  models  were  roughly  c'jmparable  to 
the  field  experiment  data  describing  reasons  for  the  nonexistence  of 
line  of  sight.  These  model  data  were  extracted  and  transformed  into  data 
roughly  comparable  to  the  field  data,  but  they  were  not  used  In  the  model 
comparisons  because  it  was  recognized  that  the  models  would  always  know 
why  LOS  did  not  exist  but  participants  in  the  field  experiment  sometimes 
could  only  guess.  Further,  it  appeared  likely  that  LOS  could  be  inter- 
rupted at  more  than  one  point  between  the  observer  and  target  for  more 
than  one  reason.  It  was  r->t  clear  what  decision  logic  was  used  in  the 
field  when  this  condition  was  perceived.  However,  the  fundamental  data 
essential  for  model  verification  were  available  within  each  model,  and 
the  model  modifications  necessary  for  extracting  them  were  accomplished 
without  major  difficulty. 

b.  Factors  Affecting  Intervisibility.  As  the  study  proceeded,  it 
became  increasingly  apparent  that  a number  of  factors  affecting  Intervis- 
ibility might  receive  different  treatment  in  the  field  experiment  and  in 
one  or  more  of  the  models.  These  differing  treatments,  which  stemmed 
from  both  model  and  field  experiment  design,  were  examinpd  on  a case  by 
case  basis  as  they  were  identified.  The  principal  consic  ration  in  deter- 
mining whether  action  was  necessary  in  each  case  was  the  need  for  main- 
taining an  acceptable  balance  between  attaining  model  results  representa- 
tive of  model  capabilities  in  normal  application  and  controlling  extra- 
neous sources  of  variation  between  the  models  and  the  field  experiment. 

Each  of  whe  factors  identified  as  receiving  different  treatments  and  the 
extent  to  which  these  problems  could  be  resolved  are  outlined  beiow. 

(l)  Direction  of  observation.  All  Intervisibility  data  collected 
during  the  field  experiment  were  produced  by  data  teams  observing  from 
points  along  the  attacker  routes  the  panels  on  the  defensive  posi tion . 
While  this  procedure  is  always  used  in  lUA  for  computing  line  of  sight, 
during  normal  operation  of  DYNTACS  and  CARMONETTE,  LOS  is  computed  from 
the  "observer's"  position  regardless  of  whether  that  element  is  an 
attacker  or  defender.  This  potential  problem  was  eliminated  by  making 
the  LOS  computations  in  all  three  models  from  points  along  the  attacker 
routes . 
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(2)  Definition  of  intervisibility.  For  purposes  of  collecting 
field  data  on  Site  A,  intervisibility  was  said  to  exist  between  two  points 
whenever  either  could  be  seen  from  the  other.  This  working  definition 

of  intervisibility  made  no  provision  for  those  cases  in  which  line  of 
sight  existed  but  the  terrain  was  not  sufficiently  open  to  permit  the 
employment  of  antitank  missiles  (e.g.,  data  collectors  had  to  look 
through  nearby  tree  branches  to  see  a defender  panel).  This  working 
definition  is  also  used  by  all  three  models  so  no  real  problem  existed 
with  respect  to  comparability  of  data  collected  for  Site  A.  However, 
this  definition  was  modified  somewhat  during  the  collection  of  field 
data  on  Site  B.  On  Site  B,  data  collectors  were  required  to  identify 
those  cases  in  which  LOS  existed  but  missiles  could  not  be  used.  Fortu- 
nately, the  procedure  used  in  the  field  for  recording  this  additional 
information  merely  called  for  the  addition  of  a flag  to  the  basic  data 
in  order  to  indicate  the  existence  of  this  special  condition.  Thus, 
intervisibility  data  as  defined  by  the  original  definition  was  recovered 
from  the  field  data  by  simply  ignoring  these  flags,  thereby  avoiding  the 
possibility  of  different  definitions  of  intervisibility  in  producing  the 
model  and  field  data.  It  should  be  noted  that  the  study  team's  decision 
to  follow  this  approach  in  no  way  indicated  that  either  of  these  defini- 
tions is  preferable  to  the  other.  In  fact,  the  latter  definition  appears 
to  be  appropriate  for  simulating  actual  engagements  involving  antitank 
missiles,  while  the  former  is  preferred  for  examining  the  detection  cycle. 

(3)  Vegetation  play.  The  various  ways  in  which  the  models  handle 
vegetation  was  another  area  of  concern.  While  unsuitable  representation 
of  vegetation  in  a model  was  generally  to  be  treated  as  a model  deficiency 
rather  than  as  a source  of  extraneous  variation  between  model  and  field 
experiment,  some  modification  to  the  original  terrain  data  prepared  for 
the  models  was  necessary  to  insure  that  model  and  field  experiment  results 
would  be  comparable.  Model  inputs  describing  vegetation  on  the  experi- 
mentation sites  were  developed  using  procedures  prescribed  by  the  model 
documentation.  The  approach  normally  followed  in  using  all  three  models 
is  to  develop  terrain  inputs  independent  of  the  tactical  plan,  then  to 
overlay  the  tactical  situation  on  the  terrain  and  play  the  battle.  This 
approach  is  somewhat  fallacious  because  it  underemphasizes  the  extreme 
importance  of  vegetation  in  the  immediate  vicinity  of  the  defensive  (tar- 
get) positions.  For  example,  because  a considerable  portion  of  the  de- 
fensive position  on  Site  A was  covered  by  dense  forests,  the  terrain  data 
originally  prepared  for  the  models  depicted  forests  on  the  defensive 
position.  In  the  model  test  runs,  this  vegetation  often  produced  complete 
blockage  of  line  of  sight  to  defender  weapons  located  within  the  forested 
areas.  Yet,  defender  weapon  positions  in  the  field  experiment  had  been 
selected  primarily  for  their  long  range  observation  and  fires.  Because 
conscientious  model  users  probably  would  have  identified  and  corrected 
this  discrepancy  in  normal  model  applications,  it  was  decided  to  strip 
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the  forest  data  from  the  areas  In  which  defenders  were  positioned,  thereby 
enabling  these  weapons  to  enjoy  in  the  models  the  long  range  observation 
and  fires  to  which  they  were  obviously  entitled. 

3-b.  SUMMARY  OF  MODEL  PREPARATION.  Preparation  of  the  models  consisted 
of  accomplishing  three  specific  tasks:  sets  of  inputs  for  the  models 

comparable  to  those  of  the  field  experinent  had  to  be  identified  and 
prepared,  the  model  modifications  necessary  to  extract  comparable  output 
data  from  the  models  had  to  be  designed  and  implemented,  and  several 
possible  sources  of  extraneous  variation  between  model  and  field  experi- 
ment results  had  to  be  investigated  and  dealt  with.  Completion  of  these 
preparations  provided  three  models  set  up  to  produce  (1)  intervisibility 
data  for  conditions  similar  to  those  of  the  field  experiment,  and  (2) 
model  results  that  could  be  considered  generally  representative  of  model 
capabilities  in  typical  applications. 
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CHAPTER  4 


COMPARISON  METHODOLOGY 

4-1.  GENERAL.  Earlier  in  this  report,  the  distinction  was  made  between 
the  development  of  study  methodology  and  comparison  methodology,  with 
the  latter  being  defined  as  the  selection  of  a suitable  set  of  procedures 
for  comparing  model  and  field  experiment  data.  Frojn  the  early  stages  of 
the  study  it  was  obvious  that  quantitative  comparisons  between  the  results 
of  the  models  and  the  field  experiment  were  highly  desirable;  however,  the 
identification  and  final  selection  of  suitable  comparison  variables  and 
comparison  procedures  constituted  a sizeable  research  and  analysis  task. 
The  purpose  of  this  chapter  is  to  describe  those  variables  and  procedures 
selected  and  to  outline,  where  appropriate,  the  rationale  underlying 
their  selection. 

4-2.  STANDARDS.  Because  the  ability  of  tank  and  antitank  weapon  crews 
to  acquire,  engage,  and  neutralize  hostile  elements  is  dependent  on  the 
existence  of  line  of  sight,  it  appeared  that  a model  would  have  to  repre- 
sent intervisibility  with  considerable  accuracy  In  order  to  produce  a 
reasonably  accurate  simulation  of  tank-antitank  battles.  Ideally,  the 
models  would  produce  correct  LOS  determinations  between  every  stake  and 
every  panel  for  each  of  the  six  combinations  of  the  attacker  and  defen- 
der height.  While  such  total  representation  of  the  real  world  may  not 
be  attainable,  it  is  clear  that  the  models'  representation  of  LOS  must 
be  accurate  in  several  respects  considering  the  uses  the  models  will  make 
of  the  representation.  First,  the  total  amounts  of  LOS  have  to  be  ac- 
curate to  keep  weapons  possessing  specific  capabilities  (e.g.,  high  rate 
of  fire,  high  probability  of  kill)  from  being  placed  at  an  unfair  advan- 
tage (or  disadvantage)  in  the  models.  Sec'nd,  because  the  target  acqui- 
sition, engagement,  and  neutralization  processes  are  range  related,  these 
areas  of  line  of  sight  must  occur  at  the  right  general  battlefield  loca- 
tions In  the  models.  Third,  the  models  have  to  describe  accurately  the 
LOS  conditions  between  the  specific  areas  to  be  occupied  by  defender  wea- 
pons and  each  of  the  various  areas  to  be  traversed  or  occupied  by  attacker 
elements.  Fourth,  the  LOS  data  from  the  models  have  to  differentiate 
accurately  among  different  attacker  and  defender  weapon  heights  so  that 
LOS  between  specific  types  of  attacker  and  defender  weapons  is  portrayed 
correctly.  Finally,  the  tendency  of  LOS  "YES"  determinations  to  occur 
consecutively  (in  strings)  must  be  represented  accurately  by  the  models 
In  view  of  their  use  In  the  logical  structure  of  the  models”. 

4-3.  DIVERSE  APPROACH.  As  the  study  team  became  more  deeply  involved 
in  the  intervisibility  study,  it  became  increasingly  apparent  that  more 
than  one  approach  had  to  be  taken  in  comparing  the  model  results  to  those 
of  the  field  experiment  for  several  reasons.  First,  the  study  team  was 
unable  to  Identify  any  single  comparison  procedure  that  would  be  fully 
sufficient  for  determining  whether  acceptable  accuracy  of  LOS  representa- 
tion was  achieved  by  a model  with  respect  to  all  these  different  accuracy 


4-1 


requirements.  Second,  the  use  of  several  different  procedures  in  per- 
forming these  comparisons  provided  for  lower  risk  in  the  sense  that  a 
mistake  made  in  applying  an  appropriate  technique  or  the  application  of 
an  inappropriate  technique  would  not  necessarily  invalidate  study  findings 
Finally,  examination  of  the  data  through  the  use  of  several  different  pro- 
ceciures  provided  an  increased  understanding  of  inodel  results  and  assisted 
in  isolating  particular  trends.  Thus,  it  was  decided  that  the  use  of  sev- 
eral different  procedures  for  comparing  model  and  field  experiment  results 
was  indicated. 

4-4.  COMPARISON  VARIABLES.  The  desirability  of  using  several  different 
procedures  for  comparing  the  model  and  field  data  and  the  requirement  for 
examining  the  accuracy  of  LOS  data  from  the  models  with  respect  to  several 
different  criteria  necessitated  the  use  of  several  comparison  variables. 
All  of  these  variables  were  derived  from  the  fundamental  1 ine-of~sight  de- 
termination (YES  or  NO)  data,  and  each  is  discussed  briefly  below. 

a.  Fundamental  LOS  Data.  The  fundamental  data  collected  from  the 
field  experiment  and~EHe  models  were  the  basic  LOS  "YES  or  NO"  determina- 
tions between  each  stake  and  each  panel  for  each  height  combination.  Of 
the  models,  only  DYNTACS  collected  these  LOS  data  from  the  exact  stake 
locations  used  in  the  field  experiment;  therefore,  only  the  DYNTACS  re- 
sults could  have  been  compared  to  these  data  on  a one-for-one  basis. 
Because  of  the  desirability  of  evaluating  the  performance  of  all  three 
models  using  the  same  comparison  variables  and  methods,  it  was  decided 
that  this  comparison  variable  would  not  be  used  directly  in  the  compari- 
sons. 

b.  Number  of^  LOS  Segments . Initially,  the  "line  of  sight  segment" 
characterizaTTon  orTntervisiBi  1 i ty  appear^  to  be  attractive  for  compar- 
ing model  and  field  experiment  intervisibility  for  several  reasons.  How- 
ever, the  study  team  developed  a number  of  reservations  concerning  the 
suitability  of  the  LOS  segment  as  a comparison  variable;  and,  in  the  final 
analysis  of  model  performance,  the  use  of  the  LOS  segment  was  deemphasized 

(1)  Relevance.  Insight  into  the  relevance  of  the  LOS  segment 
characterization  of  intervisibility  is  provided  by  the  following  discus- 
sion. Line-of-sight  determinations  in  the  models  play  an  important  role 
in  establishing  the  logical  progression  of  simulated  battlefield  activi- 
ties. On  any  number  of  occasions  during  a simulated  battle,  the  selec- 
tion of  an  appropriate  succeeding  activity  for  an  element  hinges  on  the 
outcome  of  an  LOS  determination.  Thus,  a representative  logical  progres- 
sion within  the  simulated  battle  is  established  only  when  these  line-of- 
sight  determinations  accurately  reflect  the  actual  LOS  conditions  of  the 
battlefield.  This  problem  is  complicated  by  the  introduction  of  a sam- 
pling problem  since  the  models  do  not  check  LOS  continuously.  Thus,  a 
comparison  variable  that  requires  the  models  to  assemble  these  funda- 
mental LOS  "YES"  determinations  into  correct  patterns  was  needed.  The 
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bivariate  distribution  of  line-of-sight  segments  (categorized  by  length 
of  segment  and  range  at  segment  initiation)  appeared  to  do  precisely  that. 

(2)  Limitations.  A major  limitation  of  the  LOS  segment  as  a 
comparison  variable  was  identified  during  the  sensitivity  analysis  per- 
formed on  the  field  experiment  data  (see  appendix  B) . One  of  the  find- 
ings of  that  analysis  was  that  the  LOS  segment  characterization  of  inter- 
visibility exhibits  sensitivity  to  relatively  small  changes  in  the  funda- 
mental LOS  data  from  which  the  segments  are  derived.  Because  the  study 
team  was  unable  to  rule  out  the  possibility  that  a moderate  error  rate 
exists  in  the  fundamental  data  collected  in  the  field,  it  was  decided  that 
the  use  of  LOS  segment  distributions  involved  a moderately  risky  approach 
to  making  direct  comparisons  between  model  and  field  resu'>':s.  Thus,  these 
derivative  data  were  used  only  to  gain  insights  into  the  extent  to  which 
the  models  tended  to  produce  unbroken  strings  of  LOS  "YES"  determinations. 

(3)  Observation.  One  observation  should  be  made  concerning  the 
sensitivity  of  the  LOS  segment  distributions.  It  appears  that  the  proce- 
dure used  for  classifying  the  segments  according  to  the  ranges  at  which 
they  occur  is  a major  contributor  to  the  sensitivity  of  these  distribu- 
tions. For  example,  changing  the  LOS  determinations  at,  say,  three  stakes 
along  a continuous  segment  of  3,000  meters  length  not  only  produces  a total 
of  four  segments  in  place  of  the  previous  one,  but  three  of  the  four  seg- 
ments may  then  be  reclassified  into  completely  different  range  bands  than 
the  one  used  previously.  Thus,  not  many  changes  in  the  underlying’data 
need  to  be  made  before  the  (bivariate)  distribution  of  LOS  segments  bears 
little  resemblance  to  its  original  form.  It  seems  likely,  however,  that 
a suitable  classification  procedure  can  eventually  be  devised  that  would 
permit  reliance  on  the  LOS  segment  as  a principal  comparison  variable. 

If  so,  the  benefits  to  be  realized  are  considerable  because  the  LOS  seg- 
ment provides  a direct  measure  of  most  of  the  relevant  aspects  of  inter- 
visibility. 

c.  Number  of  Stakes  with  LOS.  Each  LOS  "YES"  dete>mination  between 
one  stake  ahcT one"  panel  was  'termed  a "stake  with  LOS"  for  purposes  of  dis- 
cussion. Thus,  the  number  of  stakes  with  LOS  is  merely  a cumulation  of  all 
the  individual  "YES"  determinations.  Stakes  with  LOS  were  classified  by 
path,  range  band,  and  defender  weapon;  and  these  data  formed  the  basis  for 
most  of  the  conclusions  that  resulted  from  the  intervisibility  study.  Two 
points  should  be  made  concerning  this  comparison  variable.  First,  this  i 

variable  differs  from  the  fundamental  LOS  data  only  in  that  an  aggregation 
of  stakes  is  made  within  each  500-meter  range  band  on  a path.  Thus,  this  J 

variable  is  only  as  sensitive  to  error  in  the  underlying  data  as  are  the  j 

underlying  data  themselves.  Second,  because  LOS  data  for  fewer  stakes  were  1 

produced  by  both  lUA  and  CARMONETTE  than  were  collected  in  the  field,  an 
adjustment  to  the  number  of  stakes  with  LOS  produced  by  these  models  was  ] 

necessary  to  make  the  data  comparable  to  those  of  the  field  experiment.  3 

The  actual  adjustments  made  are  described  in  chapter  5. 
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d.  Amount  of  Battlefield  Visible.  One  additional  comparison  variable 
was  used  tFat  req'uires  some  explanation.  The  total  length  of  all  LOS  seg- 
ments was  computed  for  each  site  (and  height  combination)  and  is  referred 
to  as  the  "amount  of  battlefield  visible."  This  statistic  is  an  aggrega- 
tion over  all  defender  weapons  (panels)  and  all  stakes  (thus,  all  paths 
and  all  range  bands),  and  it  provides  an  indication  of  the  overall  open- 
ness or  closeness  of  the  battlefield.  Major  differences  in  this  statistic 
between  model  and  field  data  indicate  that  major  differences  between  the 
two  necessarily  exist,  though  close  comparability  would  not  necessarily 
mean  that  model  and  field  results  agree  with  respect  to  the  important  cri- 
teria discussed  in  paragraph  2 of  this  chapter.  It  should  also  be  noted 
that  this  statistic  is  also  only  as  s “sitive  to  error  as  the  fundamental 
field  data  themselves. 

4-5.  COMPARISON  METHODS.  Comparisons  between  the  model  and  field  data 
were  made  by  applying  simple  mathematical  techniques,  standard  statisti- 
cal tests,  and  subjective  judgment  to  the  comparison  variables  described 
above.  The  simple  mathematical  methods  and  the  uses  of  subjective  judg- 
ment require  little  explanation  and  are  therefore  described  within  the 
analysis  in  chapter  5.  However,  the  statistical  procedures  are  more  in- 
volved and  are  described  below. 

Application.  Three  types  of  statistical  tests  were  used  in  com- 
paring the  model  and  the  field  experiment  data:  the  three-way  contin- 

gency table,  the  T-test  for  paired  observations,  and  the  nonparametric  sign 
test.  These  three  tests  were  applied  as  a set  and  were  used  to  compare 
model  and  field  experiment  data  for  both  LOS  segments  and  for  the  numbers 
of  stakes  with  LOS. 

(1)  LOS  segments.  Line-of-sight  segments  were  categorized  with 
respect  to  their  length  and  the  range  at  which  they  were  initiated,  thus 
creating  a bivariate  distribution  of  LOS  segments.  Since  these  distribu- 
tions existed  for  both  model  and  field  experiment  data  for  each  site  and 
all  attacker-defender  height  combinations,  these  bivariate  model  and  field 
experiment  distributions  could  be  compared  for  any  height  combination  on 
any  site. 

(2)  Stakes  with  LOS.  A similar  procedure  was  applied  to  the 
stakes  with  LOS  from  the  model  and  field  data.  Bivariate  distributions 
were  formed  by  classifying  each  stake  with  LOS  with  respect  to  path  and 
range  band  (aggregating  over  all  defender  weapons).  Again,  separate  dis- 
tributions were  created  for  each  height  combination  on  each  site. 

b.  Procedure.  Because  the  procedure  applied  was  the  same  regardless 
of  which  b'f  the  two  comparison  variables  was  used,  the  procedure  is  des- 
cribed below  only  as  it  was  applied  to  the  bivariate  distributions  of  LOS 
segments,  with  the  understanding  that  the  same  description  applies  to  the 
testing  of  stakes  with  LOS. 
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(1)  Description.  In  applying  this  procedure,  a three-dimensional 
matrix  was  formed  by  using  the  appropriate  bivariate  distribution  from  the 
model  as  level  (page)  one  and  that  from  the  field  experiment  as  level  (page) 
two.  This  matrix  was  used  to  test  the  null  hypothesis  that  the  source  of 
the  data  (model  or  field  experiment)  is  independent  of  the  other  two  clas- 
sification criteria*,  that  is,  this  test  for  independence  determines  whether 
the  bivariate  distributions  of  these  occurrence  data  an.  the  same.  The 
statistical  representation  of  this  null  hypothesis  is: 


Pijk  “ PijPk 

The  probability  of  being  in  cell  i,j,k  is  the  product  of  the  maximum  likeli- 
hood estimate  of  the  probability  of  having  a particular  i , j pair  of  values 
and  the  maximum  likelihood  estimate  of  the  probability  of  having  a particular 
k value.  The  probability  of  having  an  LOS  segment  in  a given  cell  is  used 
to  calculate  the  expected  number.  The  expected  number  is  used  to  calculate 
the  test  statistic: 


(observed  number-expected  number) 


2 


/ 


expected  number 


i,j,k 

The  test  statistic  has  a limiting  distributiv>n  of  x and  has  (I*J-1)(K-1) 
degrees  of  freedom. 


(2)  Limitations.  Two  problems  exist  with  the  test.  First, 
the  expected  frequency  of  obse>-vation  should  be  at  least  five  for  each 

cell.  Since  there  were  large  areas  of  sparse  data  in  the  typical  LOS  matrix 
(and  some  in  the  stakes  with  LOS  data),  the  matrix  had  to  be  contracted  by 
combining  rows  or  columns  until  the  minimum  expected  numbf  rs  of  observations 
were  attained.  The  general  rule  in  grouping  these  data  was  to  preserve  as 
many  degrees  of  freedom  as  possible.  The  x2  test  was  then  applied  to  the 
contracted  matrix.  The  second  limitation  of  the  test  is  that  it  only  de- 
termines whether  the  model  and  field  experiment  distributions  are  the  same. 
Thus,  the  model  could  theoretically  produce  10  times  as  many  LOS  observa- 
tions as  the  field  experiment  and  still  pass  the  test  provided  that  line 
of  sight  was  similarly  distributed.  Therefore,  it  was  also  necessary  to 
test  whether  the  total  number  of  occurrences  was  the  same.  For  this  reason, 
two  additional  tests  were  added  to  form  a three-test  statistical  package. 

For  the  first  additional  test,  the  page  one  entries  (model  data)  and  page 
two  entries  (normally  CDEC  data)  with  the  same  I and  0 values  in  the  con- 
tracted matrix  were  considered  to  be  a pair  of  observations.  The  page  one 
entry  was  subtracted  from  the  page  two  entry  to  form  an  I by  J difference 
matrix.  The  mean  and  variance  were  computed  for  the  entries  in  this  dif- 
ference matrix  using  maximum  likelihood  estimates.  The  T-test  was  then 
used  to  test  the  hypothesis  that  the  mean  of  the  values  in  the  difference 
matrix  wa%  zero.  The  second  test  added  was  also  performed  on  the  values 
in  the  difference  matrix.  The  nonparametric  sign  test  was  used  to  test 
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the  null  hypothesis  that  the  probability  of  a minus  sign  was  0.5.  If  it 
was  not  possible  to  reject  the  null  hypothesis  for-  either  of  these  addi- 
tional statistical  tests,  then  the  two  data  sets  were  said  to  have  the 
same  number  of  elements. 

4-6,  SUMMARY.  A suitable  methodology  had  to  be  developed  for  determining 
whether  differences  existed  between  intervisibility  results  of  the  models 
and  the  field  experiment.  Methodology  development  consisted  of  (1)  identi- 
fying those  criteria  with  respect  to  which  model  and  field  results  had  to 
agree  closely,  and  (2)  selecting  suitable  comparison  variables  and  pro- 
cedures. The  successful  completion  of  this  work  enabled  the  study  team 
to  perform  the  model -field  experiment  comparisons  described  in  the  next 
chapter. 
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COMPARISON  ANALYSIS 

5-1.  GENERAL.  As  the  preliminary  work  described  in  the  preceding  sec- 
tions neared  completion,  a suitable  plan  for  running  the  three  models 
was  finalized  and  the  model  runs  were  begun.  This  plan  called  for  three 
basic  runs  of  each  model,  one  for  each  of  the  three  field  trials  that 
produced  the  CDEC  intervisibiltty  data;  and  each  run  was  designed  to  pro- 
duce data  that  could  be  considered  representative  of  the  model's  capa- 
bilities. Analysis  of  the  preliminary  model  runs  revealed  a number  of 
errors  made  by  the  study  team  in  setting  up  and  operating  the  three 
models.  Several  runs  of  each  model  were  actually  required  before  the 
study  team  was  satisfied  that  problems  of  this  nature  had  been  elimi- 
nated. Once  these  problems  were  overcome,  a series  of  comparisons 
between  data  produced  by  each  model  and  by  the  field  experiment  was 
performed.  These  comparisons  and  the  rest  cir.g  conclusions  related  to 
model -field  experiment  comparability  are  reported  in  this  chapter. 
Supplementary  runs  were  then  made  in  an  effort  to  investigate  specific 
questions  related  to  unique  design  features  of  each  model,  and  these 
are  reported  in  chapters  6 and  7.  Lessons  learned  in  setting  up  and 
operating  the  three  models  are  reported  in  appendix  E. 

5-2.  MODEL  RUN  PLAN.  During  the  process  of  developing  suitable  input 
data  for  the  three  models,  it  was  discovered  that  unique  values  (or  pro- 
cedures for  arriving  at  these  values)  did  not  exist  for  a number  of  the 
required  model  inputs  and  that  this  problem  was  shared  by  all  three 
models.  These  ambiguities  presented  a problem  with  respect  to  model  veri- 
fication in  that  attempts  to  investigate  even  a relatively  small  number 
of  these  possibilities  would  have  expanded  the  task  beyond  manageable 
proportions.  In  view  of  the  overall  objectives  of  this  study,  it  appeared 
that  a full  investigation  of  this  type  would  not  be  necessary.  The  pur- 
pose of  the  study  was  to  determine  whether  confidence  should  be  placed  in 
the  models'  abilities  to  produce  reliable  predictions  of  battlefield  in- 
tervisibility using  model  inputs  developed  a pHorTTrom  available  ter- 
rain data.  Thus,  finding  that  one  or  two  particular  combinations  might 
produce  reasonably  good  model  results  would  be  of  little  interest  if  the 
number  of  possible  combinations  was  large,  and  the  one  or  two  good  com- 
binations probably  would  not  be  identified  in  normal  model  usage.  It 
also  appeared  that  required  model  inputs  that  were  ambiguous  to  the  study 
team  would  be  equally  ambiguous  to  most  model  users  and  that  all  reason- 
ably conscientious  model  users  would  have  about  the  same  problems  and 
‘successes  in  arriving  at  suitable  inputs. 


a.  Basic  Model  Runs.  It  was  decided  that  a single  "best  estimate"  for 
each  of  Ihese  parameters  would  be  developed  with  the  expectation  that  the 
model  results  produced  would  be  representative  of  those  obtained  in  normal 
applications  of  the  model.  Therefore,  three  basic  runs  of  each  model  were 
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required,  one  for  each  of  the  three  field  trials.  One  aspect  of  this 
run  plan  bears  consent  at  this  point.  One  of  the  three  models,  DYNTACS, 
includes  in  its  design  probabilistic  treatments  of  certain  aspects  of 
elevation  and  vegetation.  Thus,  it  would  seem  at  first  glance  that  the 
basic  evaluation  of  OYNTACS  should  be  based  upon  replication  using  various 
initial  random  number  seeds  rather  than  upon  single  model  runs.  However, 
the  probabilistic  treatment  in  DYNTACS  of  these  aspects  of  terrain  repre- 
sents an  attempt  to  conserve  computer  resources  (both  computer  time  and 
core  storage)  by  handling  these  physical  realities  probabil istically  when  in 
fact  such  treatment  is  not  necessary.  The  assumption  underlying  this 
approach  is  that  DYNTACS  will  represent  the  actual  terrain  with  reasonable 
fidelity  regardless  of  the  initial  random  number  seed  chosen.  It  was  de- 
cided that  a single  random  number  seed  would  be  used  for  all  three  runs 
and  that  the  sensitivity  of  OYNTACS  results  to  the  random  number  seed 
would  be  Investigated  in  the  supplementary  runs. 

b.  Supplementary  Model  Runs.  In  addition  to  the  three  basic  runs, 
several  supplementary  runs  of  two  of  the  models  were  made  in  an  effort 
to  investigate  specific  aspects  of  each  model's  design.  The  results  of 
these  supplementary  runs  are  reported  separately  in  the  two  succeeding 
chapters , 

5-3.  COMPARISON  OF  MODEL  AND  FIELD  EXPERIMENT  RESULTS.  The  data  pro- 
duced by  the  three  basic  runs  of  each  model  were  compared  to  the  corres- 
ponding field  data  in  several  different  ways.  The  results  of  these  com- 
parisons are  presented  below,  with  successive  subparagraphs  devoted  to 
each  of  these  different  comparison  procedures. 

a.  /^;<ount  of  Battlefield  Visible.  The  cumulative  length  of  all  the 
1 ine -of -sTghf  segments  for  a given'  site  and  tactic  was  computed  and  is 
referred  to  as  the  amount  of  battlefield  visible.  The  amount  of  batt'e- 
field  visible,  expressed  in  visible  kilometers,  is  an  aggregated  measure 
of  the  intervisible  traces  along  all  10  attacker  routes  when  viewed  from 
all  36  defender  positions.  It  provides  a gross  indication  of  the  open- 
ness or  closeness  of  a particular  terrain  site.  These  data  are  presented 
for  the  field  experiment  and  the  three  models  in  tables  5-la,  lb,  and  Ic. 
(Because  of  their  length,  these  tables,  as  well  as  tables  5-2  through  5-4, 
are  placed  at  the  end  of  this  chapter.)  Differences  between  the  model 
and  Held  experiment  data  expressed  as  a percent  of  the  field  experiment 
data  appear  in  parentheses  in  these  tables.  Several  observations  con- 
cerning these  data  should  be  made: 

(1)  The  models  view  the  Hunter-Liggett  terrain  as  much  more  open 
than  is  indicated  by  the  field  experiment  data  with  the  one  exception  of 
lUA  on  Site  B. 

(2)  From  these  lUA  data,  it  appears  that  the  model  might  have 
done  reasonably  well  on  Site  B.  (Subsequent  analyses  show  these  data  to 
be  highly  midleading.) 
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(3)  Both  DYNTACS  and  CARMONETTE  overstate  total  intervisibility 
on  Site  B to  a far  greater  degree  than  on  Site  A. 

(4)  All  three  models  indicate  that  changes  in  weapon  height 
affect  intervisibility  to  a greater  extent  than  the  field  data  show. 

b.  Line -of -Sight  Segments.  From  the  limited  sensitivity  testing 
of  the  fT^cf  ex'perTment' oataT  base  described  in  appendix  B,  it  was  con- 
cluded that  the  line-of-sight  segment  characterization  of  intervisi- 
bility provided  an  unstable  measure  for  comparing  the  models  to  the 
field  experiment.  However,  these  data  do  provide  some  indication  of 
the  nature  of  differences  between  the  models  and  the  field  experiment 
and  the  extent  to  which  these  differences  exist. 

(1)  Mean  LOS  segment  lengths.  A summary  of  the  numbers  of  line- 
of-sight  segments  and  the  mean  segment  lengths  is  provided  in  tables 
5-2a,  2b,  and  2c.  These  summary  data  seem  to  indicate  that  the  models 
tend  to  produce  longer  line-of-sight  segments  than  were  observed  in 

the  field.  It  should  also  be  noted  that  major  disparities  exist  among 
all  four  in  terms  of  the  relationship  between  height  combination  and 
the  number  of  LOS  segments, 

(2)  Number  of  LOS  segments.  The  numbers  of  line-of-sight  seg- 
ments classified  by  length  of  segment  and  range  of  initiation  are  pre- 
sented for  each  model  in  tables  5-3a  through  31.  (It  should  be  noted 
that  the  procedure  used  throughout  the  intervisibility  study  for  com- 
puting range  is  considerably  different  from  that  used  in  previous  re- 
ports on  TETAM.  For  model  verification,  it  was  necessary  to  identify 
trends  with  respect  to  specific  areas  of  the  battlefield.  Therefore, 
range  was  computed  as  the  (shortest)  distance  from  any  point  on  the  bat- 
tlefield to  the  straight  line  generally  describing  the  forward  edge  of 
the  battle  area  (FEBA).)  The  manbers  of  LOS  segments  from  the  field 
experiment  corresponding  to  these  model  data  are  shwvn  in  parentheses. 
Data  for  Site  A (Covered  Approach)  are  not  included  here  as  they  are 
similar  to  the  Site  A (Rapid  Approach)  data.  Several  observations  con- 
cerning these  data  are  appropriate  at  this  point. 

(a)  The  classification  of  LOS  segments  into  length  group- 
ings confirms  the  earlier  impression  that  all  three  models  tend  to  pro- 
duce longer  stretches  of  continuous  line  of  sight  than  was  repov'ted  from 
the  field. 


(b)  In  fact,  all  three  models  produce  far  fewer  segments 
shorter  than  200  meters  and  far  greater  numbers  of  very  long  segments 
(800+  meters)  than  were  recorded  during  the  field  experiment. 

c.  Line-of-Sight  Stakes.  The  most  reliable  measure  upon  which  to 
base  compa’H sons  between  model  and  field  experiment  results  is  the  funda- 
mental line-of-sight  (YES-NO)  data.  The  most  straightforward  procedure 
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for  comparing  these  fundamental  LOS  data  would  have  been  simply  to  com- 
pare and  tabulate  the  number  of  agreements  between  the  model  and  field 
data  at  each  stake  from  which  data  were  collected.  Since  only  DYNTACS 
computed  LOS  data  for  the  exact  stake  locations  used  in  the  field  and 
because  it  appeared  desirable  that  a single  procedure  be  used  for  evalu- 
ating data  from  all  three  models,  this  simple  procedure  was  not  adopted, 
stead,  the  total  number  of  line-of-sight  "YES"  observations  between  all 
stakes  and  panels  were  counted  and  classified  according  to  range  band 
and  path  for  both  the  model  and  field  data.  Because  the  Intervals  at 
which  LOS  data  were  produced  by  lUA  and  CARMONETTE  were  greater  than 
the  Interval  used  In  the  field  experiment,  the  number  of  "YES"  observa- 
tions from  each  model  had  to  be  adjusted  by  an  appropriate  factor  to 
make  the  model  data  comparable  to  those  from  the  field.  A single  factor 
was  used  to  adjust  model  data  for  each  site  (and  tactic),  and  this 
factor  was  defined  as  the  ratio  of  the  total  number  of  LOS  observations 
("YES"  and  "NO")  from  the  field  experiment  to  the  total  number  of  LOS 
observations  from  the  model.  Specific  values  for  these  factors  are  sum- 
marized below: 


Site  (Tactic) 

DYNTACS 

lUA 

CARMONEHE 

Site  A (Rapid  Approach) 

1.00 

1.097 

4.402 

Site  A (Covered  Approach) 

1.00 

1.105 

4.350 

Site  B (Rapid  Approach) 

1.00 

1.092 

3.606 

The  adjusted  number  of  LOS  "YES"  observations  from  each  model  classified 
by  range  band  and  path  and  the  corresponding  data  from  the  field  experi- 
ment (shown  In  parentheses)  are  presented  in  tables  5-4a  through  41. 
Again,  data  for  Site  A (Covered  Approach)  are  similar  to  those  shown  for 
Site  A (Rapid  Approach)  and  are  not  presented  here.  Several  observations 
with  respect  to  these  data  should  be  made  here; 

(1)  Differences  between  the  model  and  field  data  are  spread 
across  most  of  the  path-range  band  classifications. 

(2)  While  the  models  show  more  intervisibility  than  the  field 
experiment  In  the  majority  of  the  classification  categories,  the  oppo- 
site Is  true  often  enough  (particularly  on  Site  A)  to  Indicate  that  these 
differences  may  be  attributable  to  a variety  of  causes. 

(3)  Dlffet^nces  on  Site  A become  particularly  pronounced  at 
ranges  greater  than  2,500  meters  where  all  three  models  show  much  more 
Intervisibility  than  Is  Indicated  by  the  field  data. 

(4)  On  Site  B,  both  the  DYNTACS  and  CAFMONEHE  data  indicate 
that,  in  general,  much  more  can  be  seen  at  all  ranges  than  was  reported 
by  the  field  experiment. 
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(5)  IDA  results  for  Site  B appear  to  be  erratic  in  that  lUA 
shows  consistently  less  intervisibility  than  the  field  experiment  for 
paths  2,  3,  4,  and  5 and  consistently  more  for  paths  7,  8,  9,  and  10. 

5-4.  ANALYSIS  OF  DIFFERENCES.  The  data  presented  to  this  point  estab- 
lish that  major  differences  exist  between  the  results  produced  by  the 
three  models  and  the  field  experiment.  Although  some  observations  were 
made  concerning  general  trends  in  these  differences,  the  data  presented 
were  too  highly  aggregated  to  support  a detailed  analysis  of  differences. 
Thus,  it  was  necessary  to  add  a third  dimension  to  the  classification 
scheme  so  that  the  data  would  be  broken  out  according  to  defender  weapon 
position  (panel)  as  well  as  by  path  and  range  band.  The  basic  variable 
used  in  this  analysis  was  th^  total  number  of  stakes  on  a given  path 
^d  in  a parti cular  (500 -meter)  range"  bem'd  Trom  which~Tine  of  sigh^ 
exTsTs  To  a specvfic  dPeTender  \^apon  position.  (This  comp'anson  vari- 
5bTe  IS  s'liFsequently  referred  to  as  the  ‘‘'number  of  stakes  with  LOS"  for 
simplicity.)  Since  the  LOS  data  were  collected  from  along  10  attacked' 
paths  for  36  defender  weapon  positions  and  were  subsequently  classified 
into  8 arbitrary  range  bands,  a total  of  2,880  separate  classification 
cate.^ories  exist.  The  number  of  stakes  with  LOS  from  the  models  were 
compared  to  the  corresponding  data  from  the  field  expeiiment  for  each 
of  these  2,880  classification  categories  on  each  site,  and  these  com- 
parisons formed  the  basis  for  the  analysis  of  differences. 

a.  Categorization  of  Differences.  Differences  observed  in  these 
2,880  corni' 'Vfsbns  we’^e  ^Fi'en  categorized  according  to  their  magnitude 
using  a co/- blnatinr.  . f mathematical  and  judgmental  criteria.  Differ- 
ences u /;  vaen  the  model  and  field  data  were  expressed  as  percentages 
computed  i:.  follows: 


Percent  difference 


(Number  of  model  stakes  with  LOS) 
(Number  of  field  stakes  with  LOS) 


-1 


Because  there  were  only  about  35  stakes  both  with  and  without  line  of 
sight  in  a typical  range  band  on  any  path,  and  because  often  only  a few 
of  these  were  s+ake:.  w1  th  l , it  was  necessary  to  complement  these  per- 
centage computations  wTtTV  iome  subjective  judgments  in  evaluating  the 
magnitude  of  observed  differences  to  prevent  distortions  that  result 
from  computing  percent  differences  between  two  numbers  when  one  (or  both) 
is  very  small.  A sunmary  of  the  combined  criteria  used  to  classify 
these  differences  is  shown  ' ^able  5-5.  The  tolerance  on  the  number 
of  stakes  is  expressed  to  ti.  cares t half  stake  to  provide  for  compar- 

able treatment  of  adjusted  and  CAra*iONETTE  data  and  unadjusted  DYNTACS 
data. 
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Table  5-5.  Classification  of  Differences 


Magnitude  of 

Model  Predicts  Number  of  Field 

Di f ference 

Experiment  Stakes  with  LOS  Within... 

Little  or  No  Difference 

1.5  stakes  or  15  percent  of  stakes 

Moderately  Different 

2.5  stakes  or  30  percent  of  stakes 

Seriously  Different 

4.5  stakes  or  50  percent  of  stakes 

Completely  Different 

All  other  possibilities 

b.  Distribution  of  Differences.  The  addition  of  defender  weapon 
pos i ti on  as  the ^TindUi meh^ohnfn' the  classification  scheme  provided 
intervisibility  data  for  specific  pairings  of  defender  weapons  with  par- 
ticular areas  on  the  battlefield.  Thus,  comparisons  of  the  model  and 
field  data  for  these  2,880  categories  give  some  indication  not  only  of 
how  much  total  intervisibility  is  associated  with  each  specific  area  of 
the  battlefield  but  also  of  whether  this  intervisibility  is  associated 
with  the  appropriate  defender  weapons.  Figures  5-la  and  lb  show  the 
relative  frequencies  with  which  differences  of  varius  magnitudes  occur 
for  Site  A (Rapid  Approach).  From  these  data  it  is  obvious  that  the 
models  and  field  experiment  are  in  serious  conflict  at  least  as  often 
as  they  are  in  general  agreement  when  determining  the  degree  to  which 
intervisibility  exists  between  individual  defender  positions  and  specific 
areas  of  the  battlefield.  These  same  data  for  Site  B are  presented  in 
figures  5 -2a  and  2b.  The  data  indicate  that  disagreement  between  the 
field  experiment  and  the  DYNTACS  and  CARMONETTE  models  is  more  pronounced 
on  Site  B than  on  Site  A and  that  the  "very  close— very  different"  dicho- 
tomy persists.  Little  weight  should  be  placed  on  the  lUA  results  shown 
here  fcr  reasons  that  are  outlined  in  subsequent  discussion. 


c.  Other  Trends.  Two  other  general  trends  of  differences  between 
the  modeTs~and  field  experiment  were  identified. 

(1)  Figures  5-3a  through  3d  show  for  Sites  A and  B the  relative 
frequencies  of  model  and  field  experiment  agreement  (within  15  percent) 
as  a function  of  the  number  of  field  experiment  stakes  with  LOS.  These 
data  show,  as  one  might  expect,  that  the  models  are  more  likely  to  agree 
when  either  none  or  most  of  the  stakes  had  LOS  in  the  field,  and  this 
trend  is  present  on  both  sites.  To  some  extent,  particularly  on  Site  A, 
these  data  are  the  result  of  a number  of  situations  where  it  is  clear 
that  LOS  either  does  or  does  not  exist.  However,  the  magnitude  of  this 
effect  might  also  indicate  that  the  models  have  more  trouble  as  the  ter- 
rain scene  becomes  more  complex.  Figures  5 -3c  and  3d  show  why  little 
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Low  Attacker,  Low  Defender 
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weight  should  t>e  placed  on  the  IDA  results  for  Site  B.  In  addition  to 
the  erratic  patterns  for  lUA  described  earlier  in  paragraph  3c(5),  the 
preponderance  of  lUA  agreements  occur  when  the  field  data  report  that 
few  or  no  stakes  with  LOS  exist.  Where  sufficient  amounts  of  LOS  exist 
for  the  purposes  of  employing  antitank  weapons,  IDA  agrees  with  the 
field  experiment  less  than  half  as  often  as  the  other  two  models. 

(2)  The  one  other  trend  identified  from  these  data  is  the  con- 
firmation of  the  tendency  of  all  three  models  to  view  the  terrain  gen- 
erally as  more  open  than  indicated  by  the  field  data.  The  data  pre- 
sented in  figures  5 -4a  and  4b  show  not  only  that  this  trend  exists  in 
the  aggregate  but  aUo  that  in  general  each  of  the  individual  defender 
weapons  tends  to  "see"  more  of  the  battlefield  than  it  should  according 
to  the  field  data. 

5-5.  SUMMARY  OF  COMPARISONS.  Sufficient  control  was  established  over 
the  development  of  model  inputs  to  insure  that  reasonable  comparisons 
of  model  and  field  experiment  results  could  be  accompli slied.  The  models 
were  set  up  using  input  data  designed  to  mirror  field  experiment  condi- 
tions as  closely  as  possible  while  at  the  same  time  producing  model  re- 
sults representative  of  those  realized  during  typical  applications  of 
the  models.  Three  basic  runs  were  made  with  each  model,  one  correspond- 
ing to  each  of  the  three  trials  of  the  intervisibility  field  experiment 
conducted  at  Hunter-Liggett.  The  intervisibility  data  produced  by  these 
model  runs  were  then  compared  to  corresponding  data  collected  in  the 
field.  These  comparisons,  performed  using  several  different  procedures, 
resulted  in  the  following  principal  findings: 

a.  Major  differences  exist  between  the  intervisibility  conditions 
recorded  in  the  field  experiment  and  those  predicted  by  all  three  models. 
The  extent  to  which  these  differences  exist  is  obvious  regardless  of  the 
procedures  used  for  comparing  the  data. 

b.  In  a typical  model  run,  defensively  employed  antitank  weapons 
see  approximately  the  "right"  amount  (i.e.,  same  amount  as  reported  by 
the  field  experiment)  of  specific  areas  of  interest  on  the  battlefield 
about  40  percent  of  the  time.  These  same  weapons  see  vastly  different 
amounts  of  these  areas  than  they  should  (according  to  the  field  data) 
at  least  40  percent  of  the  time  as  well. 

c.  There  is  a strong  tendency  for  the  models  to  predict  more  inter- 
visibility than  was  reported  by  the  field  experiment.  This  strong  effect 
is  present  at  all  ranges  and  for  most  defender  (and  attacker)  weapons. 

d.  All  three  models  produce  substantially  longer  line-of-sight  seg- 
ments than  were  observed  in  the  field.  Under  the  presumption  that  the 
field  data  are  correct,  the  implication  is  that  during  normal  model 
applications  attackers  and  defenders  will  be  expose,  to  each  other's 
observations  and  fires  for  longer  than  realistic  periods. 
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Ficure  5-4b.  Frequency  with  Which  Models  Show  Battlefield  as  More 
Open  Than  Reported  by  Field  Fxperiment,  Riven  That 
Model  and  Field  Observations  Differ  by  More  Than 
15  Percent,  Low  Attacker,  Low  Defender 
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e.  All  three  models  indicate  that  intervisibility  is  affected  to 
a much  greater  extent  by  changes  in  weapon  height  than  is  indicated  by 
the  field  data.  It  is  also  worth  noting  that  changes  in  weapon  height 
change  the  number  of  LOS  segments  in  uniquely  different  ways  for  the 
field  experiment  and  for  each  model . 

f.  Differences  between  the  model  and  field  experiment  data  become 
more  pronounced  at  longer  ranges.  This  divergence  becomes  noticeable 
at  a range  of  about  2,500  meters  on  Site  A and  1,500  meters  on  Site  B. 

I 

g.  The  models  are  most  likely  to  agree  with  the  field  experiment 
(on  the  extent  to  which  specific  defender  weapons  can  see  specific  areas 
of  the  battlefield)  in  those  cases  in  which  the  field  experiment  indi- 
cated that  either  none  or  almost  all  of  the  specific  area  can  be  seen. 

5 
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Table  5-la.  Amount  of  Battlefield  Visible  to  Defenders 
on  Site  A (Rapid  Approach) 
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Table  5-lc.  Amount  of  Battlefield  Visible  to  Defenders 


Table  5-2b.  Comparison  of  Line  of  Sight  Segments 
Site  A (Covered  Approach) 
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Table  5-2c.  Comparison  of  Line  of  Sight  Segments 


Table  5-3a.  Number  of  LOS  Segments  for  Site  A (Rapid  Approach) 
DYNTACS  vs  (CDEC),  Hi  Attacker,  Hi  Defender 
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Table  5-3b.  Number  of  LOS  Segments  for  Site  A (Rapid  Approach) 


Table  5-3c.  Number  of  LOS  Segments  for  Site  A (Rapid  Approach) 
lUA  vs  (CDEC),  Hi  Attacker,  Hi  Defender 
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Number  of  LOS  Segments  for  Site  A (Rapid  Approach 
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Table  5-3e.  Number  of  LOS  Segments  for  Site  A (Rapid  Approach) 


SA 

cn  f-H 

O VO 

o u> 

to  o 

m 

00 

o o 

CM  tr> 

^ m 

CM  CM 

CM  CM 

CM  •-« 

o 

CM 

'• — ' 

U3  <Ti  O'  VO 
CO  O 


c o 

o o 

•*-  ir> 

CM 

ff)  • 

•f-  O 

■M  O 

O 

C CM 


to 

O 

_l  o 
o 
o 

•O  CM 
I 

a>  o 
o»  o 

C U) 
lO  ‘ < 

Of 


ro  CO  CO  CO 

VO  CM  CM  VO 

vn  — ' 


O 

C VO 
j=  <u  V- 

Ei 

cj)  cn  4-> 
c OJ  <u 
<u  to  E= 
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Table  5-3i.  Number  of  LOS  Segments  on  Site  B (Rapid  Approach) 

lUA  vs  (CDEC),  Hi  Attacker,  Hi  Defender 
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Table  5-4b.  Number  of  Stakes  with  LOS  on  Site  A (Rapid  Approach) 
DYNTACS  vs  (CDEC),  Low  Attacker,  Low  Defender 
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Table  5-4k.  Number  of  Stakes  with  LOS  on  Site  B (Rapid  Approach 
CARMONETTE  vs  (CDEC),  Hi  Attacker,  Hi  Defender 
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Table  5-41.  Number  of  Stakes  with  LOS  on  Site  B (Rapid  Approac 
CARMONETTE  vs  (CDEC),  Low  Attacker,  Low  Defender 
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CHAPTER  6 


SIDE  AUALYSIS— DYNTACS 

6-1  GENERAL.  The  model  runs  described  in  the  preceding  chapter  were 
considered  by  the  study  team  to  be  representative  of  DYNTACS  capabilities 
in  typical  applications  and  therefore  sufficient  for  the  purpose  of  de- 
termining whether  major  differences  existed  between  results  obtained 
from  the  model  and  the  field  experiment.  However,  during  this  work  a 
number  of  interesting  questions  arose  concerning  specific  aspects  of  the 
DYNTACS  line-of-sight  methodology.  In  an  effort  to  gain  a better  under- 
standing of  the  model  itself  and  to  investigate  the  relative  importance 
of  certain  specific  model  assumptions  and  procedures,  several  additional 
runs  of  the  DYNTACS  LOS  routines  were  made  under  varying  conditions.  The 
principal  reasons  for  performing  each  of  these  additional  runs  and  the 
findings  that  resulted  are  presented  in  this  chapter. 

6-2.  RANDOM  NUMBER  SEED.  One  obvious  and  very  important  question  con- 
cerning the  DYNTACS  LOS  methodology  was  to  determine  the  degree  to  which 
intervisibility  is  affected  by  changing  the  random  number  seed.  In  view 
of  the  large  number  of  LOS  determinations  collected  during  a single  model 
run  and  the  relatively  high  level  of  aggregation  used  in  the  comparisons, 
the  study  team  felt  that  substantial  differences  in  intervisibility  ought 
not  to  result  from  changing  only  the  random  number  seed.  Additional 
model  runs  were  performed  and  analyzed  to  determine  the  sensitivity  of 
intervisibility  in  DYNTACS  to  changes  in  the  random  number  seed. 

a.  Run  Plan.  Three  additional  random  number  Sieds  were  selected  and 
tested  to  insure  they  would  produce  suitable  strings  of  random  numbers. 
Using  these  seeds,  three  additional  runs  of  the  DYNTACS  LOS  routines  were 
performed  for  the  Site  A (Rapid  Approach)  conditions.  Thus,  a total  of 
four  model  runs  were  available  for  use  in  evaluating  model  sensitivity. 

The  initial  seeds  for  each  of  these  runs  were  as  follows: 

Repl i cation  Number  Random  Number  Seed 

1 1946328857 

2 65539 

3 524287 

4 1638766249 

b.  Analysis  Procedures . Summary  data  for  the  four  runs  are  contained 
in  table  6-1 . Similarity  is  noted,  particularly  for  the  total  amount  of 
battlefield  visible.  The  standard  series  of  statistical  tests  (described 
in  chapter  4)  was  applied  to  these  data  for  all  six  pairwise  combinations 
of  the  four  runs.  The  results  of  these  tests  are  summarized  in  tables 
6-2a  and  2b  for  the  number  of  stakes  with  LOS  and  in  tables  6-3a  and  3b 
for  LOS  segments,  with  the  indicated  decision  of  accepting  or  rejecting 
the  null  hypothesis  that  the  runs  do  not  differ.  The  consideration  of 
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Table  6-1.  Sunmary  Results  for  Four  Replications 
of  OYNTACS  on  Site  A (Rapid  Approach) 
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Table  6-3a.  Summary  of  Statistical  Testing  on  LOS  Segments,  Site  A 
(Rapid  Approach),  High  Attacker,  High  Defender 


Table  6-3b.  Summary  of  Statistical  Testing  on  LOS  Segments,  Site  A 
(Rapid  Approach),  Low  Attacker,  Low  Defender 


number  of  stakes  provides  an  indication  of  chanof-  iti  the  fundamental 
distribution  of  LOS  "YES"  data  over  the  experimentation  site,  while  the 
segn«nt  data  are  indicators  of  change  in  actual  patterns  of  LOS  (the 
extent  to  which  stakes  with  LOS  occur  consecutively). 

c.  Results . From  these  data,  the  following  findings  related  to  model 
sensitivity  to  random  number  seed  resulted: 

(1)  Varying  the  choice  of  random  number  seed  produces  observable 
changes  in  intervisibility  results  for  UYNTACS  at  Hunter-Liggett.  Whether 
these  differences  are  of  sufficient  magnitude  to  have  operational  signi- 
ficiance  is  not  clear.  These  changes  are  more  pronounced  for  the  lower 
height  combination. 

(2)  One  would  expect  this  effect  to  be  more  pronounced  In  very 
rough  terrain  than  in  smooth  terrain.  In  light  of  the  fact  that  the 
experimentation  sites  at  Hunter-LIggett  are  relatively  flat  (hence  the 
estimates  of  microterrain  standard  deviations  input  to  the  model  were 
small),  it  Is  possible  that  the  effect  of  random  number  seed  on  Intervisi- 
blllty  In  normal  model  applications  (e.g.,  in  Europe  where  microterrain 
standard  deviations  are  likely  to  be  larger)  could  be  significant  In  an 
operational  sense. 

(3)  The  Implication  Is  that  variations  in  terrain  makeup  can  be 
introduced  by  the  random  number  from  replication  to  replication  and  that 
terrain  may  be  an  uncontrolled  factor  in  some  DYNTACS  applications. 

6-3.  DIRECTION  OF  DIAGONALS.  The  general  surface  of  the  battlefield  in 
DYNTACS  (the  macroterrain  surface)  is  formed  by  triangular  elevation 
planes  established  from  the  uniformly  spaced  elevation  data  used  in  the 
model.  This  macroterrain  surface  is  formed  by  assuming  that  these  tri- 
angular planes  should  be  established  as  shown  in  figure  6-1. 

LEGEND 


• Elevation  Point 
1 Elevation  Plane 


Figure  6-1.  Formation  of  the  DYNTACS  Macroterrain  Surface 

The  pitfalls  in  establishing  elevation  planes  through  an  arbitrary  pro- 
cedure of  this  nature  are  illustrated  in  figures  6-2a  and  2b. 
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Figure  6-2a.  DYNTACS  Terrain  Figure  6-2L>.  Actual  Terrain 

The  arbitrary  procedure  used  in  DYNTACS  will  always  represent  the  situa- 
tion shown  in  figure  6-2a  while  the  actual  terrain  might  look  like  that 
shown  in  figure  6-2b.  The  DYNTACS  design  assumes  that  the  interval  be- 
tween elevation  points  will  be  selected  such  that  the  effects  of  the 
phenomenon  shown  in  figures  6-2a  and  2t>  arc  not  significant.  If  the  in- 
terval normally  used  in  DYNTACS  work  meets  this  criterion,  then  reversing 
the  direction  of  these  arbitrarily  establisiied  diagonals  should  not  affect 
results.  Further,  in  a typical  model  application,  the  actual  DYNTACS  grid 
is  normally  rotated  so  as  to  provide  the  greatest  amount  of  flexibility 
to  the  gamers  in  portraying  the  tactical  situation  under  study.  Thus, 
the  angle  between  the  diagonals  in  the  DYNTACS  grid  and  the  direction  of 
attacker  movement  can  assume  any  value.  An  assumption  implicit  in  this 
procedure  is  that  intervisibility  between  attackers  and  defenders  will  not 
be  altered  significantly  by  the  direction  in  which  these  diagonals  are 
arbitrarily  established.  For  these  reasons,  tlie  DYNTACS  LOS  routines  were 
modified  so  that  these  diagonals  were  established  from  upper  right  to 
lower  left  in  each  grid  rather  than  in  the  normal  direction. 

a.  Run  Plan.  The  purpose  of  this  investiiiatiun  was  to  determine 
whether  changing  the  direction  of  these  diagonals  would  tiave  a significant 
effect  on  intervisibility.  One  additional  model  run  was  made  for  the  Site 
A (Rapid  Approach)  conditions  using  tlie  random  number  seed  from  the  basic 
model  run  (Replication  #1). 

b.  Analysis  Procedure,  because  changing  l.lie  direction  of  the  diago- 
nals alters  the  random  number  sequent e,  th(>  r.uiMom  r.umber  was  not  control- 
led for  this  run  in  the  strict  sense.  Huis,  tiie  addiulondl  model  run  was 
compared  to  all  four  of  the  replications  uest.i  ibed  previously.  The  summary 
data  in  table  6-4  indicate  that  ciuuiging  Uie.o  diagonals  from  a direction 
generally  parallel  to  attacker  movci  .;nt  to  one  ‘jetuo'ally  perpendicular  to 
this  movement  reduces  total  intervis ibi  1 i t,y  by  / to  lb  percent  depending 

on  height  combination.  The  results  of  stati'^tical  testing  on  stakes  with 
LOS  and  LOS  segnents  are  sunniarized  in  Laoloi>  b-ba  and  bb  and  tables  6-6a 
and  6b,  respectively . 
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Table  6-5a.  Summary  of  Statistical  Testing  on  Stakes  with  LOS,  Site 
(Rapid  Approach),  High  Attacker,  High  Defender 
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c.  Resul ts.  The  following  findings  resulted  from  this  investiga- 
tion ; 


(1)  Changing  the  direction  of  DYNTACS  diagonals  from  one  generally 
parallel  to  the  direction  of  attacker  movement  to  one  generally  perpendicu- 
lar to  this  movement  results  in  a su^'stantial  reduction  in  the  amount  of 
intervisibility  between  attacker  and  defender  elements  for  the  terrain 

i nvestigated. 

(2)  This  change  also  produces  a pronounced  shift  in  the  distribu- 
tion of  intervisibility  across  the  battlefield. 

6-4.  SUMMARY.  The  two  specific  aspects  of  the  DYNTACS  LOS  methodology 
investigated  were  model  sensitivity  to  the  random  number  seed  and  to  the 
directions  in  which  the  diagonals  of  elevation  triangles  are  established. 
These  investigations  revealed  that  changes  in  the  random  number  seed  did 
produce  observable  changes  in  representation  of  intervisibility  on  Site  A 
for  the  low  height  combinations.  Whether  these  differences  would  be 
significant  in  an  operational  sense  is  not  known.  It  was  also  learned 
that  significvat)t  and  systematic  changes  in  intervisibility  can  be  introduced 
by  the  widely  practiced  arbitrary  rotation  of  the  DYNTACS  battlefield. 
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CHAPTER  7 


SIDE  AHALYSIS—lIJA 

/-i.  GENERAL.  As  was  the  case  with  the  basic  DYMTACS  runs,  the  IDA 
model  runs  described  in  chapter  5 were  believed  to  be  representative  of 
LOS  results  achieved  in  typical  applications  of  the  model  and  therefore 
sufficient  for  giving  a reasonable  indication  of  model  capabilities. 
However,  during  the  model  preparation  work,  it  became  obvious  that  all 
three  models  required  some  subjectivity  to  be  introduced  during  the  pre- 
paration of  model  inputs,  and  lUA  appeared  to  be  particularly  bad  in  this 
respect.  It  appeared  likely  that  even  slight  changes  in  some  of  these 
subjective  parameters  in  lUA  would  have  a drastic  effect  on  LOS  results. 
For  this  reason,  some  additional  investigations  of  the  ILIA  model  were 
pursued.  The  principal  reasons  for  performing  these  investigations  and 
the  findings  tliat  resulted  are  presented  in  this  chapter. 

7-2.  TERRAIN  CODING.  A major  area  of  concern  requiring  further  investi- 
gation was  the  handcoded  terrain  data  base  for  lUA.  Relatively  minor 
changes  in  defender  weapon  elevations  appear  to  have  pronounced  effects 
on  intervisibility  in  both  tiie  field  data  and  the  model  results.  It 
appeared  reasonable  to  expect  that  variations  inherent  in  the  subjective 
procedures  for  coding  the  lUA  terrain  data  might  be  significant.  In  an 
attempt  to  determine  the  model's  sensitivity  to  small  changes  in  the 
terrain  data  and  to  assess  in  both  relative  and  absolute  terms  the  suit- 
ability of  the  coded  terrain,  several  checks  on  the  terrain  data  were 
raade . 


a.  Elevation  Checks.  In  an  effort  to  determine  the  accuracy  with 
which  IDA  represented  elevations  within  the  defender  position  on  Site  A, 
the  elevations  of  the  36  defender  weapons  as  computed  by  the  model  were 
compared  to  corresponding  elevations  takeu  from  the  1/25,000  military 
mapsheet.  This  comparison  revealed  that  differences  in  elevations 
ranged  from  0 to  28  meters.  The  mean  difference  for  the  36  positions 
was  9.8  meters,  and  the  median  was  8 meters.  In  view  of  the  fact  that 
in  the  field  experiment  data  observable  differences  in  intervisibility 
often  resulted  between  height  combinations  where  the  elevation  change  is 
less  than  2 meters,  it  appeared  that  terrain  data  in  the  vicinity  of  the 
defender  position  on  Site  A was  of  unacceptable  resolution. 

Terrain  Resolution.  The  lUA  results  discussed  in  chapter  5 were 
sufficientTy  different  from  those  of  DYNTACS  and  CARMONETTE  to  indicate 
that  the  lUA  terrain  data  might  have  been  of  insufficient  resolution  over 
the  entire  experimentation  site  as  well  as  in  the  vicinity  of  the  Site  A 
defensive  area.  For  this  reason,  the  resolution  of  the  Hunter-Liggett 
terrain  data  was  evaluated  in  two  ways. 
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(1)  Mrst,  in  an  effort  to  evaluate  the  adequacy  of  terrain  re- 
solution in  relative  terms,  the  triangle  size  used  to  represent  the 
Huiii-er-Liggett  terrain  was  compared  with  the  three  terrain  areas  used  for 
most  lUA  study  applications--the  Fulda  sites  prepared  by  Lockheed  Corpor- 
ation for  the  TATAWS  study.  The  results  of  this  comparison  are  sumnarized 
in  table  7-i.  These  data  by  themselves  are  of  limited  value  unless  used 
in  conjunction  with  an  estimate  of  the  required  terrain  resolution  on 
each  of  these  sites.  However,  based  upon  a s'uB’jective  comparisou  of  map- 
sheets  of  the  Fulda  and  Hunter-Liggett  areas,  it  appears  that  the  resolu- 
tion of  the  Hunter-Liggett  terrain  data  was  at  least  as  good  as  that  used 
in  previous  model  applications. 


Table  7-1.  lUA  Terrain  Resolution  for  Hunter-Liggett  and  Fulda  Areas 


• 

Terrain  Area 

, • 

HLMR 

Fulda  101 

Fulda  102 

Fulda  103 

Number  of  Triangles 

500 

431 

524 

299 

Size  of  Battlefield 
(in  kilometers) 

5x8 

5x10 

5x8 

Mean  Area  per  Triangle 
(square  meters) 

36,800 

49,800 

50,500 

72,600 

(2)  Second,  in  an  effort  to  evaluate  the  sufficiency  of  resolu- 
tion of  the  HLMR  terrain  data,  using  the  yardstick  of  i^solution  inquired, 
the  terrain  data  prepared  for  IDA  were  compared  visually  with  aerial  ' 
photos  of  the  experimentation  sites.  This  comparison  indicated  that  in- 
sufficient attention  had  been  paid  to  vegetation  during  the  coding  of  the 
terrain  trianglesi  and,  therefore,  the  lUA  terrain  data  provided  a rela- 
tively poor  representation  of  the  large  trees  scattered  throughout  the 
experimentation  site.  Thus,  while  the  terrain  data  were  probably  at 
least  as  good  as  those  used  in  ILIA  in  the  past,  in  an  absolute  sense  it 
is  likely  that  these  data  provided  a relatively  poor  description  of  the 
actual  Hunter-Liggett  terrain. 


7-3.  PLACEMENT  OF  OBJECTIVE  POINTS.  The  placement  of  route  and  axis  i 
objective  points  was  a second  matter  of  major  concern  because  lUA  com-  ^ 
putes  line  of  sight  from  points  along  the  attacker  routes  to  the  objec-  I 
tive  points  rather  than  to  specific  defender  weapons.  All  defender  I 
weapons  in  the  vicinity  of  these  objective  points  are  then  assumed  to  j 
have  the  sane  fields  of  observation  and  fire  as  the  objective  points.  | 
Assuming  that  accurate  representation  of  intervisibility  between  attacker  | 


and  defender  elements  on  the  battlefield  is  a precondition  to  acceptable 
simulation  of  tank-antitank  warfare,  tnen  the  lUA  procedure  for  computing 
line  of  sight  is  unacceptabld  for  two  reasons. 

a.  First,  it  is  obvious  from  the  magnitude  of  the  changes  in  inter- 
visibility that  result  from  relatively  small  changes  in  defender  location 
that  changes  in  the  placement  of  objective  points  can  have  a drastic 
effect  on  intervisibility.  Because  these  objective  points  are  assigned 
subjectively  (and  without  benefit  of  definitive  assignment  criteria), 
drastic  differences  in  intervisibility  can  be  expected  between  parallel 
attempts  to  portray  the  same  tactical  plan. 

b.  Second,  the  assumption  underlying  this  procedure  for  computing 

LOS  implies  that  defender  weapons  are  only  rarely  employed  against  attacker 
weapons  approaching  on  routes  other  than  the  one  to  which  that  defender 
weapon  is  assigned.  The  assumption  is  implicit  in  the  lUA  nethodology 
because  computations  made  to  determine  LOS  conditions  between  a specific 
defender  weapon  and  attacker  weapons  on  other  routes  and  axes  are  made  to 
points  within  the  defensive  position  that  often  are  not  even  in  the 
general  vicinity  of  that  defender  weapon.  This  problem  is  particularly 
pronounced  for  defensive  positions  similar  to  the  one  for  Site  A where 
the  difference  in  elevation  between  the  highest  and  lowest  defender 
weapons  is  nearly  100  meters. 

7-4.  fiODEL  RUN  PLAN.  It  was  decided  that  supplementary  model  runs  were 
necessary  to  determine  whether  substantial  improvements  in  model  results 
could  be  realized  by  correcting  these  two  serious  problems.  However,  due 
to  the  seriousness  of  both  problems,  there  appeared  to  be  no  reliable 
way  of  evaluating  a promising  solution  to  one  without  also  including  a 
solution  for  the  other  in  the  same  n.odel  run.  Therefore,  only  one  addi- 
tional model  run  was  made  and  that  run  included  both  individual  weapon- 
to-weapon  computations  of  intervisibility  and  improved  terrain  resolu- 
tion throughout  the  defensive  position  on  Site  A.  (Improved  terrain  re- 
solution was  limited  to  the  defensive  position,  however.)  The  Site  A 
(Rapid  Approach)  conditions  were  selected  for  the  supplementary  run. 

7-5.  ANALYSIS  OF  RESULTS.  To  determine  whether  substantive  improvements 
had  been  achieved,  it  was  necessary  to  compare  the  results  of  this 
supplementary  model  run  to  both  field  experiment  data  and  data  from  the 
previous  lUA  run.  Summary  data  for  the  three  are  shown  in  table  7-2. 

More  detailed  comparisons  illustrating  the  effect  of  these  model  and 
data  changes  are  presented  in  figures  7-la  and  lb  and  7-2a  and  2b. 

7-6.  FINDINGS.  This  investigation  resulted  in  the  following  supplementary 
findings  with  respect  to  the  lUA  model. 

a.  When  LOS  is  computed  on  a weapon-to-weapon  basis  and  the  terrain 
resolution  (only)  in  the  vicinity  of  the  defender  weapon  positions  is 
improved  on  Site  A,  a substantial  increase  is  noted  in  agreement  between 
model  and  field  experiment  results. 
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Table  1-Z,  Suninary  Results  for  lUA  Improveircnts 
on  Site  A (Rapid  Approach) 


COfC  Regular  Improved 

m lUA 

Number  of 
LOS  Segments 

LO  - LO  2989  1248  li:.9 

HI  - HI  3009  1140  1113 

Amount  of 

Battlefield 

Visible 

LO  - LO  458  568  ^36 

HI  - HI  521  750  586 

Mean  LOS 
Segment  Length 

LO  - LO  153  456  386 

HI  - HI  173  658  527 

b.  Because  this  marked  improvement  was  realized  within  the  constraint 
of  only  limited  improvement  in  the  terrain  representation,  further  im- 
provement in  terrain  representation  is  likely  to  further  improve  model 
results. 

7-7.  SUMMARY.  Two  major  obstacles  to  achieving  good  results  with  the 
lUA  model  were  identified  and  investigated.  Model  structure  was  modified 
in  order  to  provide  for  weapon-to-weapon  computations  of  LOS,  and  selec- 
tive improvements  in  the  terrain  data  base  were  added.  A model  run  was 
then  made  to  determine  how  this  combination  of  improvements  would  affect 
model  results.  It  was  found  that  these  two  improvements  produced  sub- 
stantially increased  agreement  between  model  and  field  experiment  results. 


CHAPTER  8 


FINDINGS  AND  CONCLUSIONS 

T-l.  GENERAL.  The  purpose  of  this  chapter  is  to  identify  the  principal 
rindings  of  the  intervisibility  comparisons,  to  identify  the  possible 
explanations  for  the  differences  observed,  and  to  present  the  conclusions 
derived  from  these  findings. 

8-2.  APPLICABILITY.  Preparation  of  the  three  models  included  the  de- 
velopment of  model  inputs  comparable  to  those  of  the  field  experiment 
and  integration  of  the  model  modifications  necessary  for  extracting  the 
appropriate  outputs  for  comparison.  The  subsequent  model  runs  produced 
(1)  intervisibility  data  for  conditions  similar  to  those  reported  for 
the  field  experiment  and  (2)  results  representative  of  i^el  capabilities 
in  typical  applications. 

8-3,  PRINCIPAL  FINDINGS.  Intervisibility  data  produced  by  each  of  the 
three  models  were  compared  to  corresponding  data  from  the  field  experi- 
ment using  several  different  methods.  The  following  findings  resulted 
from  these  comparisons: 

a.  Model  and  field  experiment  results  were  different  for  all  three 
sets  of  field  experiment  conditions,  with  the  models  tending  to  view 
the  Hunter-Liggett  experimentation  sites  as  providing  conditions  gen- 
erally more  favorable  for  target  acquisition  and  engagement  than  was 
reported  by  the  field  experiment. 

b.  These  comparisons  showed  lUA  results  to  be  erratic  on  Site  B. 

These  erratic  results,  which  may  be  representative  of  past  lUA  (and  Bonder 
lUA)  applications,  are  probably  caused  primarily  by  insufficient  resolu- 
tion of  the  terrain  data  and  by  the  simplified  procedure  used  in  lUA  for 
determining  whether  lin  of  sight  exists.  (The  lUA  side  analysis  seems 

to  indicate  that  correction  of  those  problems  would  enable  lUA  to  produce 
results  generally  comparable  to  those  of  DYNTACS  and  CARMONETTE.) 

c.  With  the  exception  of  the  lUA  results  on  Site  B,  several  general 
trends  applicable  to  all  three  models  emerged  from  these  comparisons. 

(1)  When  the  typical  defender  weapon  crew  in  a model  searches  a 
given  500-meter  stretch  of  a likely  enemy  avenue  of  approach,  the  models 
and  field  experiment  tend  either  to  agree  very  closely  or  to  disagree 
widely  as  to  the  amount  of  the  path  segment  that  can  be  seen.  These  two 
situations  are  equally  likely,  with  each  occurring  in  about  40  percent 
of  the  cases. 

(2)  In  those  cases  where  the  models  and  field  experiment  do  not 
agree,  the  models  tend  to  indicate  more  intervisibility  than  the  field 
experiment. 
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(3)  The  rnodels  arc  much  more  likc'iy  to  agree  with  the  field 
experiment  when  the  field  daca  indicate  that  either  none  or  nearly  all 
of  me  path  segment  can  be  seen  from  the  defender  position. 

(4)  All  three  models  indicate  that  changes  in  weapon  height  have 
d mucii  more  pronounced  effect  on  intervisibility  levels  than  is  indicated 
by  tile  field  data. 

d.  Additional  similarities  were  identified  between  the  DYNTACS  and 
CARMOUtTTE  model  results.  Both  models  indicate  that  the  Hunter-Liggett 
sites  are  more  open  than  was  reported,  and  the  two  generally  agree  on 
the  distribution  of  this  increased  intervisibility  across  the  battle- 
field. Differences  betv/een  the  field  data  and  both  models  also  become 
more  pronounced  with  increasing  range. 

e.  Although  no  formal  analysis  comparing  the  three  models  to  one 
another  was  prepared,  the  data  used  to  compare  the  models  to  the  field 
experiment  are  revealing  (chapter  5).  These  data  show  that  even  though 
some  similarities  exist,  the  intervisibility  results  produced  by  each 
model  are  unique  in  several  important  respects.  Even  if  the  field  data 
are  ignored,  no  more  than  one  of  the  models  can  possibly  be  accepted  as 
accurately  representing  intervisibility  at  Hunter-Liggett  because  of 
the  serious  differences  in  the  results  produced  by  the  models. 

f.  Generally,  the  degree  to  which  DYtiTACS  results  were  found  to  be 
sensitive  to  the  orientation  of  its  terrain  diagonals  demonstrates  what 
may  be  a widespread  problem  in  terrain  models--that  intervisibility 
levels  in  the  models  are  affected  to  a pronounced  degree  by  arbitrary 
model  parameters  or  inputs.  The  assignment  of  objective  point  locations 
in  lUA  is  clearly  a problem  of  this  nature;  the  assignment  of  elevations 
to  each  CARMONETTE  grid  may  also  fall  into  this  category. 

8-4.  INTERPRETATION  OF  DIFFERENCES.  The  fundamental  issue  underlying 
model  verification  is  not  whether  differences  between  model  and  field 
experiment  results  exist,  but  what  these  differences  mean  in  terms  of 
the  reliability  of  model  results.  As  indicated  in  chapter  1,  determining 
the  reasons  for  the  differences  observed  between  model  and  field  results 
and  identifying  the  proper  interpretations  as  to  their  significance  are 
both  beyond  the  scope  of  this  initial  report.  At  this  point  in  the  in- 
vestigations, it  can  only  be  stated  that  there  are  four  general  sources 
from  which  these  differences  might  stem: 

a.  The  Models.  The  terrain  models  themselves  could  contain  unsuit- 
able procedures  for  evaluating  intervisibility  conditions,  or  errors 
could  have  been  introduced  in  computerizing  these  procedures. 

b.  T^  Mod^  Inputs . Errors  could  have  been  made  ir  the  interpreta- 
tion of  mode"T~input  data  requirements  or  in  the  actual  preparation  of 
these  inputs.  Alternatively,  insufficient  detail  in  describing  the  ter- 
rain area  by  inputs  could  be  a factor. 


The  Field  Experiment  Data.  As  the  field  experiment  relied 
heavily  uponliuman  beings  as  observers , controllers,  data  recorders, 
and  data  processors,  there  are  a number  of  ways  in  which  errors  of 
various  types  might  have  crept  into  the  field  data  used  in  these  com- 
parisons . 

d.  The  Comparison  Approach.  Finally,  the  approach  taken  in  per- 
forming these  comparisons  might  have  been  inappropriate.  Either  the 
required  levels  of  correlation  implied  in  the  approach  taken  may  have 
been  too  demanding,  or  the  approach  may  be  based  upon  faulty  interpreta- 
tion of  model  or  field  results. 

8-5.  CONCLUSIONS.  In  light  of  these  cautions  on  interpretation,  only 
the  following  conclusions  appear  to  be  warranted  at  this  stage  of  the 
investigations. 

a.  Major  differences  exist  between  the  intervisibility  levols  and 
patterns  produced  by  the  three  combat  models  and  those  reported  by  the 
intervisibility  field  experiments. 

b.  The  general  lack  of  close  correlation  between  results  from  any 
two  of  the  models  seems  to  indicate  a model  problem  of  some  complexity. 

« 

c.  In  light  of  the  magnitude  of  the  differences  obsorved,  it  is 
clear  that  these  differences  must  be  resolved  before  proceeding  to  in- 
vestigations of  other  battlefield  activities  that  are  contingent  upon 
reasonable  representation  of  intervisibility. 

d.  Resolution  of  these  differences  can  only  be  accomplished  through 
follow-on  investigations  into  the  four  areas  outlined  in  paragraph  8-4 
above. 
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MODEL  BIBLIOGRAPHY 

A-1.  PURPOSE.  This  bibliography  lists  model  documentation  that  was 
available  during  the  TETAM  Model  Verification  study.  The  bibliography 
is  listed  in  annotated  form  as  an  aid  to  future  users  of  the  models. 

This  bibliography  is  not  necessarily  an  exhaustive  list  of  models  docu- 
mentation, but  the  major  sources  that  will  probably  be  available  to  a 
user  are  included. 

\-Z.  CONTENTS.  The  appendix  is  organized  into  three  annexes,  one  each 
for  DYNTACS,  lUA,  and  CARMONETTE. 

a.  Annex  I--DYNTACS.  Documentation  of  DYNTACS  is  extensive,  and  the 
bibliography  is  close  to  being  exiiaustive.  DYNTACS  documentation  is 
unique  in  that  much  of  the  early  research  that  fed  into  the  model  develop- 
ment ia  documented  as  well  as  the  model  itself.  Thus,  this  is  the  only 
model  for  which  the  basis  of  most  of  the  model  representations  can,  with 
sufficient  research,  be  found. 

b.  Annex  II--IUA.  Documentation  of  lUA  is  best  described  as  spotty. 
Adequate  information  exists  only  on  the  mechanic.,  of  operating  the  com- 
puter programs.  No  meaningful  documentation  of  the  basis  for  most  of 
the  model  formulations  has  been  found.  Model  logic  flow  is  reasonably 
documented  in  flow  chart  form.  No  discussion  of  the  ramifications  of 
various  input  values  is  available^  however,  data  bases  that  have  been 
used  are  available.  It  appears  that  users  may  tend  to  use  these  bases 
without  question. 

c.  Annex  III--CARMONETTE.  A set  of  CARMONETTE  documentation  has 
recently  been  produced.  This  provides  a reasonable  picture  of  gross  model 
logic,  some  of  the  model  algorithms,  and  the  mechanics  of  pt  .gram  opera- 
tion and  data  preparation.  Some  discussion  of  the  ramifications  of  cer- 
tain data  items  is  also  included.  No  documented  basis  for  the  formula- 
tions contained  in  CARMOiiETTE  has  been  found.  Older  CARMONETTE 
documentation  has  not  been  included  in  the  bibliography  since  none  has 
been  found  that  is  not  redundant  with  the  current  documentation. 
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ANNEX  A- -I 

ANNOTATED  BIBLIOGRAPHY  FOR  DYMTACS 

1.  EARLY  REPORTS  OF  BACKGROUND  RESEARCH  AND  PRELIMINARY  MODEL  CONCEPTS. 

a.  Bussman,  Dale  R.  Vibrations  of  a MuUiwheeled  Veln'cle.  Ohio 
State  University,  TR64-1 , August  1^677 

Equations  describing  tank  movement  on  a terrain  surface  are  presented. 

b.  Howland,  Daniel  and  Bonder,  Seth.  The  Tank  Weapon  System.  Ohio 
State  University,  AR63-1,  June  1963. 

Describes  a general  model  to  guide  and  integrate  research  in  the  re- 
lated o'eas  of  tank  mobility,  firepower,  and  survival. 

c.  . The  Tank  Weapon  System.  Ohio  State  University,  PR64-1, 

December  1963. 

Research  in  the  areas  of  soft  soil  ability  and  cross  country  mobility 
is  presented.  The  effects  of  cant  on  the  accuracy  of  the  tank  main  gun 
are  reported. 

d.  . The  Tank  Weapon  System.  Ohio  State  University,  AR64-1, 

June  1964*^ 

Tank  mobility  in  soft  soil  or  rough  terrain  is  discussed.  Develop- 
ment of  the  target  acquisition  and  fire  control  models  is  described. 

e.  . Tiie  Tank  Weapon  System.  Ohio  State  University,  AR65-1, 

June  1965. 

Separate  computer  models  are  described  for  firing,  mobility,  hit 
probabilities,  lethality,  acquisition,  and  armor  distribution. 

f.  Perloff,  William  H.  Tank  (Ability  in  Soft  Soils.  Ohio  State 
University,  TF65-2,  June  1965. 

Describes  a computer  program  for  soft  soil  mobility  analysis.  Covers 
track  slippage  and  tank  sinkage. 

2.  INITIAL  INTEGRATED  MODEL. 

a.  Howland,  Daniel  and  Clark,  Gordon.  The  Tank  Weapon  System.  Ohio 
State  University,  AR66-1,  June  1966. 

The  DYNTACS  model  is  first  referenced  in  this  manual.  A model  over- 
view is  presented  and  a detailed  description  of  five  modules,  (1)  terrain 
and  environment,  (2)  tactical  decision,  (3)  intelligence,  (4)  movement, 
and  (5)  firing,  is  included. 

b.  . The  Tank  Weapon  System.  Ohio  State  University,  AR66-2, 

December,  1966. 

Equations  describing  the  probability  of  detection  and  time  to  detection 
between  an  observer  and  tank  are  presented.  A field  experiment  to  vali- 
date those  equations  is  reported.  Microterrain  and  power  spectral  density 


as  used  in  the  ground  play  of  line  of  sight  are  discussed  in  detail. 
Detailed  descriptions  of  concealment  input  parameters  PCCS  and  YMAX  are 
included.  Soil  strength  and  limiting  speeds  for  tanks  are  also  discussed. 

3.  liii:  BASIC  GROUND  MODEL  NOW  RECOGNIZED  AS  DYNTACS. 

a.  Bishop,  Albert  and  Clark,  Gordon.  The  Tank  Weapon  System.  Ohio 
State  University,  AR69-2A,  October  1969. 

The  first  of  two  principal  analyst  manuals  for  users  of  the  DYNTACS 
manual.  Although  these  volumes  describe  in  detail  only  the  early  version 
of  the  model  known  as  DYNTACS,  documentation  of  subsequent  changes,  im- 
provements, and  additions  to  the  model  describe  only  those  parts  of  the 
model  actually  changed.  Thus,  the  model  description^  in  these  two 
analyst  manuals  apply  except  where  changed  by  subsequent  volumes.  This 
volume  contains  detailed  descriptions  of  the  DYNTACS  submodels  developed 
to  simulate  (1)  terrain  and  environment,  (2)  communications,  (3)  intel- 
ligence (i.e.,  target  acquisition),  and  (4)  movement  control. 

b.  The  Tank  Weapon  System.  Ohio  State  University,  AR69-2B, 

September,  1969 . 

The  second  of  two  principal  analyst  manuals  for  users  of  DYNTACS. 

The  remaining  five  modules  comprising  the  DYNTACS  model  are  described: 

(1)  the  fire  controller,  (2)  the  nK)vement  model,  (3)  the  firing  model, 

(4)  the  minefield  model,  and  (5)  the  indirect  fire  ballistic  weapon 
(i.e. , artillery)  model . 

c.  . The  Tank  Weapon  System.  Ohio  State  University,  AR69-4, 

September  1969. 

This  volume  is  appended  to  the  AR69  series  to  provide  the  reader  an 
overview  of  this  early  research  and  its  principal  results.  Perusal  of 
this  volume  should  provide  an  appreciation  of  the  significance  of  the 
original  methodology  produced  and  a measure  of  its  potential  usefulness 
in  the  reader's  area  of  involvement.  It  is  essentially  an  executive 
summary  of  the  early  work. 

d.  Bishop,  Albert  and  Stollmack,  Stephen.  The  Tank  Weapon  System. 
Ohio  State  University,  AR68-1,  September  19GD. 

This  volume  is  valuable  for  its  development  of  the  detection  process 
still  used  in  DYNTACS.  Chapters  covering  concepts  of  visual  detection, 
contrast-dependent  detection,  probability  for  stationary  targets,  target 
contrast,  and  analysis  of  detection  time  data  are  included.  Other  less 
important  areas  discussed  are  availability,  reliability,  rough  terrain, 
limiting  speed,  and  a methodology  for  predicting  overall  dimensions  and 
gross  weight. 

e.  Clark,  Gordon  and  Moss,  Leslie.  The  Tank  Weapon  System.  Ohio 
State  University,  AR69-3A,  June  1969. 
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This  volume  describes  the  design  and  use  of  the  DYMTACS  computer 
program.  Included  in  this  volume  are  subroutine  descriptions  and  flov/ 
charts,  detailed  descriptions  of  the  dat^  used  in  DYilTACS,  a description 
of  how  data  are  prepared  for  inout  to  OYiiTACS,  instructions  for  running 
;..ie  program,  and  sample  output.,.  Due  to  the  fact  that  DYNTACS  is  no 
longer  run  on  the  same  computer  and  extensive  modi fi cat'jons  have  been 
made  to  the  ground  game,  this  volume  is  now  of  little  value  to  most  users. 

f.  . The  Tank  Weapon  System.  Ohio  State  University,  AR69-3B, 

June  1969: 

This  volume,  a continuation  of  AR69-3A  described  above,  is  now  of 
little  value  to  most  model  users. 

4.  JYI1C0M--THE  FIRST  MAJOR  EXPAiTSIOil. 

a.  Bishop,  Daniel  and  Clark,  Gordon.  The  Land  Combat  Model  (DYriCOM). 
Ohio  State  University,  FR-1,  June  1969. 

This  volume  describes  the  design  principles  of  the  DYNCOM  model. 

DYliCOM  is  a modification  and  extension  of  the  DYNTACS  model.  This  volume 
only  describes  modifications  and  extensions  to  the  DYNTACS  model;  there- 
fore, 69-2A  and  69-2B  must  be  read  prior  to  this  volume  to  get  the  com- 
plete description  of  the  DYNCOM  model.  Major  additions  documented  in 
this  volume  are  artillery,  crew-served  weapons,  and  beam-rider  missile 
modules.  Associated  modifications  to  movement  and  firing  tactics  are 
also  presented  as  well  as  a significant  reworking  of  the  connuni cations 
model.  Additionally,  research  of  some  significance  in  modeling  conceal- 
ment, limited  visibility  conditions,  and  air/ground  and  ground/air  visual 
detection  are  reported. 

b.  Clark,  Gordon;  Parry,  Sam;  Hutcherson,  Don;  Rheinfrank,  John;  and 
Petty,  Gerald.  Land  Combat  fiodel  (DYNCOM)  Programers  Manual . Ohio  State 
University,  FR70-4A,  April  1970. 

This  programers  manual  is  a comprehensive  list  of  input  data  commons, 
program  descriptions,  and  flow  charts  of  DYNCOM.  Because  FR70-4A  and 
FR70-4B  cover  the  complete  model,  it  is  not  necessary  to  refer  to  earlier 
manuals.  A cross  reference  listed  in  this  manual  between  common  areas 
and  chapters  which  describe  the  model  can  be  a valuable  tool  for  preparing 
input  data. 


c.  Land  Combat  Model  (DYNCOM)  Programers  Manual.  Ohio  State 

University,  FR70-4B,  April  1970”. 

This  volume  is  a continuation  of  FR70-4A.  The  programers  manual  was 
broken  into  two  volumes  for  ease  of  handling. 

d.  Clark,  Gordon  and  Hutcherson,  Don.  Land  Combat  fiodel.  The  Aerial 

Platform  Combat  Operations  Model.  Ohio  State  University,  FR71-3,  May, 

I97i: 

Documents  the  aerial  platform  module  developed  for  DYNCOM.  This  mod- 
ule seems  to  have  had  limited  acceptance,  and  the  volume  is  not  of  great 
interest. 


b.  JYiiTACS-X  StCOND  MAJOR  EXPANSION. 


A.  Clark,  Gordon  and  Parry,  Samuel.  Small  Unit  Combat  Simulation 
(uY,.TACS(X))  Counterbattery  Fire  Models.  Ohio  State  University,  “R/O-l, 

July  i‘i70. 

The  DYiiTACS(X)  version  is  an  extension  to  the  DYMCOM  version.  This 
volume  reports  the  addition  of  a counterbattery  fire  module.  As  might  be 
expected,  it  has  no  direct  impact  on  the  basic  ground  combat  module. 

b.  Clark,  Gordon  et  al . Small  Unit  Combat  Simulation  (OYNTACS(X) 

Air  Defense  Operations  Model . Ohio  State  UnTversity,  Fr7T-2A,  March 

BTlT"  ^ ^ 

As  the  title  suggests,  this  volume  documents  inclusion  of  an  air  de- 
fense capability  into  the  model.  This  differs  from  most  other  model  ex- 
pansions in  that  it  could  not  be  incorporated  modularly  but  rather  required 
extensive  elaborations  to  the  basic  ground  combat  detection,  firing,  and 
fire  control  modules.  A companion  report  (same  authors,  title,  and  date, 
issued  as  FR71-2B)  contains  flow  charts  and  data  layouts. 

c.  Clark,  Gordon  and  Hutcherson,  Don.  Small  Unit  Combat  Simulation 
(DYNTACS(X))  Fire  Support  Operation  Models.  ~5>no  State  University, 

FR71-3A,  October  1971.  , ^ . 

This  volume  docunents  a revised  aerial  platform  module,  more  accepted 
than  the  one  developed  for  the  DYNCOM  version.  The  companion  volume, 
FY71-38,  contains  all  flow  charts  and  data  blocks  for  DYNTACS(X). 
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ANNOTATED  BIBLIOGRAPHY  FOR  lUA 

1.  PREPARATION  OF  THE  TERRAIN  AND  TACTICAL  DATA  BASE  AND  EXECUTION  OF 
THE  TERRAIN  AND  MOBILITY  PROCESSORS. 

a.  US  Army  Combat  Developments  Command,  Tank-Antitank  and  Assault 
Weapons  Requirements  Study,  Phase  III,  Volume  XlII,  appendix  1 1 1'  to 
annex  L,  AD849891L,  December'l9'68. 

The  document  contains  the  terrain  and  tactical  analysis  conducted 
during  the  TATAWS  study  for  the  lUA  runs.  It  also  provides  several  ex- 
amples of  the  types  of  data  needed  to  describe  the  terrain  and  the  tac- 
tics played  by  attackers  and  defenders  in  the  model. 

b.  , , Volume  XXI,  appendix  VII  to  annex  L,  AD849897L, 

December  1968. 

This  report  contains  examples  of  the  Red  and  Blue  force  compositions 
and  tactical  maneuvers  for  both  forces  used  in  the  TATAWS  runs.  A com- 
plete listing  of  the  critical  range  lines  describing  the  model's  tactical 
options  for  both  attacker  an^  defenders  can  also  be  found  in  the  report. 

2.  DOCUMENTATION  OF  THE  lUA  COMBAT  MODEL. 

US  Army  Combat  Developments  Command,  Tank-Antitank  and  Assault  Weapons 
Requirements  Study , Phase  III,  Volume  XVIII,  Tabs  C and  D oT^appendix  V 
to  annex  L,  AD849895L,  December  1968. 

The  document  contains  flow  diagrams  of  all  programs  and  subroutines 
found  in  the  lUA  combat  model . Flow  diagrams  of  subroutines  in  the 
terrain  and  mobility  models  are  not  provided.  Input  card  formats  for 
the  entire  (terrain,  mobility,  and  combat)  data  base  are  also  provided. 

3.  GENERAL  MODEL  DOCUMENTATION. 

a.  US  Army  Combat  Developments  Command,  Tank-Antitank  and  Assault 
Weapons , Phase  III,  Volume  XVII,  Tab  B of  appendix  V to  annex  L,  AD849894L, 
December  1968. 

The  document  contains  a table  of  all  key  model  variable  names  and  a 
description  of  their  content.  The  variable  names  are  grouped  by  sub- 
routine for  the  terrain,  mobility,  combat,  and  postprocessor  programs. 

b.  , , Volume  XVI,  Tab  A of  appendix  V to  annex  L, 

AD849893L,  December  1968. 

The  document  contains  a listing  of  all  lUA  programs.  This  includes 
the  terrain  processor,  mobility  processor,  lUA  combat  model,  output  event 
processor,  and  the  utility  routines  necessary  to  load  the  constant  data 
deck. 


c.  Lockheed  Missiles  and  Space  Company,  Instructions  for  Applying 
lUA  Program  to  US^  Arn\y  CPC  3300,  N-54-G8-1,  Sunnyvale , Cal fforni a , 
November  196S7 
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The  document  serves  as  an  operator's  manual,  providing  deck  structures 
for  exercising  the  model  on  the  CDC  3300.  The  data  base  file  structures 
us.  d by  the  terrain  processor,  mobility  processor,  lUA  combat  model,  and 
ouiput  event  processor  are  also  described. 

d.  US  Am\y  Combined  Arms  Conijat  Developments  Activity,  Procedure 
Guide  for  the  Individual  Uni t Action  (lUA)  Model  on  the  Fort  Leavenworth 
Data  Processing  Installation  CDC  6500  Computer  System,  Combat  Ope rations 
Analysis  Directorate  TechnicaTTeport  Th2-75,  November  1973. 

The  document  is  an  operator's  manual,  providing  deck  structure  for 
exercising  the  model  on  the  CDC  6500.  It  also  contains  a description  of 
the  input  data  card  formats  for  the  terrain  processor,  mobility  processor, 
and  lUA  combat  model. 

4.  DATA  BASES  FOR  lUA  COMBAT  MODEL. 

a.  Goulet.  B.N.,  Report  on  Support  Provided  by  Army  Material  Systems 
Analysis  Agency/Ballistic  Research  LaE^ratorips  for  YaYAWS  III  Computer 
simulation?  (U),  Army  Material  Systems  Analysis  Agency  TecFuvTcal  Memor- 
andum No  . To , Aberdeen  Proving  Ground,  Maryland,  January  1969,  (SECRET). 

Probabilities  of  hit  and  kill,  and  firing  and  flight  times  for  weapons 
and  rounds  used  in  the  TATAWS  III  lUA  combat  model  runs  can  be  found  in 
this  document.  Much  of  the  data  is  in  the  card  format  required  by  the  lUA 
nwdel . 

b.  Lockheed  Missiles  and  Space  Company,  Report  of  Simulation  Support 
for  the  Evaluation  of  Candidate  Tank  Considerations  Us~ing  the  Individual 
Unit  Action  ( I UA)  "Simulation  f;todel  '(U),  LMSC-D009535 , Sunnyvale,  Cali- 
fornia,  December  1072,  CORFIDEnTiAL. 

The  document  contains  probabilities  of  hit  and  kill  for  weapons  and 
rounds  used  in  the  Tank  Configuration  study.  Also  included  are  distri- 
butions describing  the  time  required  by  crews  to  detect  a target.  All 
data  are  in  the  format  required  by  the  lUA  model. 
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Al^l^lOTATED  BIBLIOGRAPHY  FOR  CARflONETTL 

1.  General  iiesearch  Corporation,  CARMOHETTE,  Volume  I--General  Descrip- 
tion, McLean,  Virginia,  1974. 

This  is  an  executive  level  overview  of  the  model.  It  also  contains, 

In  the  space  of  a dozen  pages,  the  only  available  discussion  of  the 
mathematical  basis  of  the  model. 

2 . , CARMONETTE , Vol ume  II--Data  Preparation  and  Output  Guide, 

McLean',  VTrginia,  1974. 

This  volume  is  oriented  to  the  Individuals  responsible  for  developing 
CARI’IONETTE  input  data.  Coding  forms  and  instructions  for  preparing  the 
data  are  Included,  with  illustrative  examples.  Discussions  of  the  rami- 
fications of  selected  data  items,  many  of  which  are  of  a subjective  or 
aggregated  nature,  are  also  included. 

3.  , CARMQNET  TE , Volume  III--Techn1cal  Documentation,  McLean,  Vir- 

ginia, 1974."' 

This  volume  is  programer  oriented.  It  documents  detailed  logical 
flow,  data  layout  within  the  computer,  and  mechanical  operating  procedures 


APPENDIX  B 


SENSITIVITY  ANALYSIS  OF  COMPARISON  VARIABLES 

B-I,  GENERAL.  IntervisiblUty  comparisons  for  TETAM  depend  upon  the  use 
of  variables  derived  from  the  fundamental  data  collected  in  CDEC  Experi- 
ment 11.8.  These  fundamental  data  are  subject  to  some  level  of  error, 
but  a statistically  sound  means  to  measure  the  error  inherent  in  the 
data  is  not  known.  Sensitivity  testing  was  conducted  to  provide  an  indi- 
cation of  the  probable  stability  of  derived  variables  and,  by  implica- 
tion, conclusions  based  upon  such  variables  in  light  of  the  possible 
error  in  the  fundamental  data. 

B-2.  APPROACH. 

a.  Fun^^ejitaJ^  Data.  The  fundamental  data  from  Experiment  11.8  of 
primary  concern  are  tHe"determined  existence  or  lack  of  intervisibility 
from  a viewing  point  in  the  field  to  an  ATM  target  panel.  In  Experiment 
11.8,  such  a determination  was  made  from  two  observer  heights  at  approxi- 
mately 2,000  viev/ing  points  to  each  of  36  target  panels  for  each  of  three 
trial  conditions  (termed  Site  A Rapid  Approach,  Site  A Covered  and  Con- 
cealed Approach,  and  Site  B) . Based  on  the  quality  control  procedures 
followed  in  the  field,  the  CDEC  final  experimentation  report  states  that 
"at  the  very  worst,  5.0  percent  of  the  data  could  be  in  error"  (refer- 
ence Id,  page  A-1-13).  Of  secondary  interest  to  this  analysis  is  the 
reported  nature  of  line-of-sight  blockages.  No  direct  quality  control 

of  the  blockage  data  was  attempted  in  the  field  experiment. 

b.  Deri ved  Variables . The  derived  variables  investigated  in  this 

analysis  are , Tor  each'oT  the  three  trial  conditions:  the  overall  proba- 

bility of  line  of  sight,  the  number  of  intervisibility  segments,  and 

the  mean  length  of  an  intervisibility  segment.  An  intervisibility  seg- 
ment is  the  space  between  consecutive  viewing  points  for  which  intervisi- 
bility to  a single  target  exists.  Intervisibility  is  assumed  to  continue 
without  interruption  between  such  viewing  points.  For  segment  length 
computations,  a change  of  intervisibility  status  between  two  points  is 
assumed  to  take  place  midway  between  the  points.  These  variables,  or 
trivial  variations  thereof,  have  been  used  by  past  studies  including 
the  CDEC  analysis  of  Experiment  11.8  results  in  an  attempt  to  describe 
terrain  on  the  basis  of  a few  descriptors. 

c.  Sensitivity  Treatments.  Four  simplistic  treatments,  discussed 
below,  were  ap'^Tea  to  the  fundamental  data  for  the  purpose  of  viewing 
the  sensitivity  of  the  derived  variables  to  changes  in  the  fundamental 
data.  Variations  similar  to  those  of  the  first  two  treatments  might 
relect  errors  that  actually  took  place  in  the  field.  Objectives  analy- 
sis or  error  modes  that  actually  occurred  in  the  field  would  have  to  be 
based  on  the  quality  control  data  collected  in  the  field  which,  unfortu- 
nately, were  discarded  in  the  field  after  serving  their  basic  purpose. 
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(1)  Random  5 percent  treatment.  For  each  "yes"  and  "no"  deter- 
iTunotion  of  line-of-s1qht  existence  In  the  data  base,  a uniformly  dlstri- 
bi  tod  random  number  on  the  unit  Interval  was  drawn  and  the  determination 
chonned  if  the  random  number  exceeded  0.95.  This  is  equivalent  to  chang- 
inq  . percent  of  the  determinations,  randomly  selected. 

(2)  Selective  5 percent  treatment.  For  each  "no"  determination 
in  the  data  base,  a uniform  random  number  was  drawn  from  the  unit  interval 
and  the  determination  changed  to  "yes"  if  the  random  number  exceeded  0.95. 
This  is  equivalent  to  changing  5 percent  of  the  "no"  determinations,  ran- 
domly selected.  Since  the  "no"  determinations  constitute  71  to  82  percent 
of  the  original  data  (depending  on  which  trial  condition  is  considered), 
this  treatment  changes  3.5  to  4 percent  of  the  data.  This  may  reflect 
field  error  to  the  extent  that  a missed  determination  is,  from  a subjec- 
tive review  of  the  experiment,  the  most  likely  error.  There  is,  however, 
no  basis  for  any  quantified  error  rate  or  for  applying  such  error  randomly 
over  the  data. 

(3)  Flicker  treatment.  For  this  treatment,  a 1 ine-of-sight  seg- 
ment is  considered  interrupted  only  if  two  or  more  consecutive  determina- 
tions of  no  line  of  sight  are  made  for  a given  ATM  panel  and  approach  path. 
Thus,  isolated  "no"  determinations  were  changed  to  "yes"  for  this  treat- 
ment. This  is  a highly  selective  treatment  resulting  in  changes  to  well 
under  2 percent  of  the  fundamental  data.  The  treatment  is  intended  to  il- 
lustrate the  critical  nature  of  a selected,  but  small,  portion  of  the  data. 
It  would  be  unduly  pessimistic  to  imply  that  such  a highly  patterned 
error  mode  in  fact  took  place  in  the  field. 

(4)  No  vegetation  treatment.  This  treatment  consisted  of  chang- 
ing each  "no"  determination  for  which  the  nature  of  blockage  was  reported 
as  being  vegetation  to  a "yes"  determination.  This  treatment  amounts  to 
a massive  modification  of  the  data  base,  resulting  in  changes  to  about 
one-third  of  the  data  for  Site  A conditions  and  80  percent  of  the  data 
for  Site  B.  No  such  extreme  error  rate  in  the  field  data  should  be  in- 
ferred. The  threatment  provides  a comparison  of  the  effects  of  a massive 
data  change  as  opposed  co  the  relatively  small  changes  of  the  other  treat- 
ments . 


B-3.  RESULTS  OF  THE  ANALYSIS,  The  results  of  the  sensitivity  analysis 
are  presenttd  in  tables  B-1  to  B-3  and  are  summarized  below.  Resulting 
derived  variables  are  presented  for  the  high-high  and  low-low  combina- 
tions of  target  panel  and  observer  height.  Values  of  the  derived  variables 
for  intermediate  height  comb in.-^t ions  fall  between  the  presented  values,  as 
would  be  expected. 

a.  Overall  Plo^  The  overall  probability  of  line  of  sight  is  rela- 
tively stable  under“all  except  the  "no  vegetation"  treatment.  This  is  to 
be  expected  from  the  nature  of  the  treatments.  Where  less  than  5 percent 
of  the  data  are  changed,  it  would  be  impossible  for  to  change  by 
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Table  B-1.  Sensitivity  Analysis,  Site  A Rapid  Approach 


Number  of 
Segments 
L*  H* 

Mean  Segment 
Length  (m) 

L*  H* 

Overall 

L* 

‘'los 

H* 

Original  data 

2961 

2943 

153 

180 

.25 

.29 

Random  5 per- 
cent treatment 

5783 

5001 

86 

95 

.20 

.31 

Selective  5 per- 
cent treatment 

5159 

5104 

100 

113 

.29 

.32 

Flicker  treatment 

2170 

2163 

221 

254 

.27 

.30 

No  vegetation 
treatment 

4553 

4042 

226 

274 

.57 

.62 

*l  - Low  observer  and  low  target  panel . 
H a High  observer  and  high  target  panel 

• 

Tabi^  2. 

Sensitivity  Analysis, 

Site  A,  Covered  Approach 

Number  of 
Segments 
L*  H* 

Mean  Segment 
Length  (m) 
L*  H* 

Overall 

L* 

’’los 

H* 

Original  data 

2888 

3155 

136 

145 

.22 

.25 

Random  5 per- 
cent treatment 

5750 

6036 

77 

81 

.25 

.27 

Selective  5 per- 
cent treatment 

5333 

5420 

06 

95 

.26 

.29 

Flicker  tr^eatment 

2115 

2267 

194 

211 

.23 

.26 

No  vegetation 
treatment 

5129 

4818 

217 

248 

.52 

.67 

*L  = Low  observer  and  low  target  panel . 

H = High  observer  and  high  target  panel. 
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Table  B-3.  Sensitivity  Analysis,  Site  B 


Number  of 
Segments 
L*  H* 

Mean  Segment 
Length  (m) 
L*  H* 

Overall 

L* 

^LOS 

H* 

Original  data 

2476 

2807 

89 

92 

.16 

.18 

Random  5 per- 
cent treatment 

4759 

5051 

56 

59 

.19 

.21 

Selective  5 per- 
cent treatment 

4566 

4765 

61 

65 

.20 

.22 

Flicker  treatment 

1697 

1855 

141 

152 

.17 

.20 

No  vegetation 
treatment 

585 

528 

2303 

2569 

.96 

.97 

*L  = Low  observer  and  low  target  panel . 

H = High  observer  and  high  target  panel. 


more  than  5 percentage  points.  In  fact,  for  all  except  the  random  5 
percent  treatment,  the  change  in  Plqj  Is  a direct  reflection  of  the  amount 
of  data  changed  by  the  treatment.  For  example,  where  P|  changes  from 
0.29  to  0.32  (selective  5 percent  treatment.  Site  A Rapid  Approach,  high- 
high  height  combination)  this  is  a direct  indication  that  3 percent  of  the 
data  were  changed  to  a "yes"  determination.  The  effect  of  the  "no  vegeta- 
tion" treatment  on  overall  P^qs  indicative  of  the  degree  to  which  vegeta- 
tion played  a role  in  the  field  determinations.  For  example,  if  the 
original  data  co.^tain  a Piq^  = 0.29  and  the  "no  vegetation"  results  in 
Plqs  = 0.62  (Site  A,  Rapid^Approach , high-high  combination)  it  can  be 
inferred  that  the  remaining  38  percent  of  the  data  must  contain  land- 
form  blockages  ("cultural"  and  "unknown"  masks  were  rarely  reported), 
and  0.62  - .29  = 0.33,  or  33  percent  of  the  blockage  on  the  site  is  caused 
by  vegetation;  that  is,  the  effects  of  vegetation  and  landform  are  approxi- 
mately equal  over  the  site.  Vegetation  clearly  is  the  dominant  factor 
on  Site  B. 

b.  Number  of  Segments.  Both  the  random  5 percent  and  the  selective 
5 percent  treatmenFs'  produce  a marked  increase  in  the  number  of  inter- 
visibility segments.  The  trend  was  to  i>e  expected,  since  the  data  tend 
to  appear  in  "strings"  of  intervisibility  or  nonintervisibility;  and  a 
random  selection  of  changes  to  be  made  would  tend  to  break  up  these 
strings.  The  extent  of  the  change  is  noteworthy.  Changes  to  at  most 
5 per  ^nt  of  the  fundamental  data  increase  the  number  of  segments  by  at 
least  70  percent  and,  in  some  cases,  essentially  double  the  number  of 
segments.  The  effect  of  the  flicker  treatment  is  totally  predictable 
since  each  changed  determination  will  connect  two  segments,  resulting 
in  a decrease  of  one  segment.  Thus,  the  decrease  in  number  of  segments 
indicates  the  exact  number  of  changes  made  with  this  treatment. 
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c.  Mean  Segment  Length.  The  effects  of  the  various  treatments  on 
mean  segment  Teng'th'  arc,  in  general,  corollary  to  their  effects  on  the 
number  of  segments.  The  marked  increase  in  number  of  segments  with  the 
random  5 percent  and  selective  5 percent  treatments  indicates  that  both 
treatments  are  introducing  a large  number  of  isolated  "yes"  stakes,  each 
of  which  would  result  in  a 2f)-meter  segment.  Additionally,  the  5 percent 
random  treatment  must  be  breaking  up  a number  of  segments  into  two  shorter 
pieces.  The  net  result  of  each  of  these  must  be  to  pull  down  mean  segment 
length.  Every  change  introduced  with  the  flicker  treatment,  on  the  other 
hand,  will  join  two  original  segments  into  one  longer  segment,  pushing  up 
the  mean  segment  length. 

B-4.  DISCUSSION. 

a.  The  most  striking  result  of  this  analysis  is  the  potentially 
extreme  sensitivity  of  variables  describing  intervisibility  segments  to 
what  would,  in  most  field  experiment  situations,  be  considered  an  accept- 
able error  rate.  This  extreme  sensitivity  appears  to  be  related  more 
strongly  to  the  pattern,  or  lack  of  pattern,  with  which  errors  could  ap- 
pear in  the  data  rather  than  to  the  actual  number  of  errors.  This  point 
is  further  illustrated  by  the  data  in  table  B-4,  in  which  the  mean  segment 
lengths  for  the  Site  A,  Rapid  Approach  trial  are  shown  for  all  height 
combinations  under  the  flicker  and  no  vegetation  treatment.  In  this  case, 
the  flicker  treatment  involves  a change  to  slightly  over  1 percent  of  the 
data,  while  the  no  vegetation  treatment  involves  a change  to  approximately 
one-third  of  the  data.  Considering  this  difference,  the  resulting  mean 
segment  lengths  are  remarkable  similar. 


Table  B-4.  Mean  Segment  Length  (Meters)  for  Selected  Treatments, 
Site  A-Rapid  Approach 


Observer 

Height 

Target 

Panel 

Original 

Data 

Flicker 

Treatment 

No  Vegetation 
Treatment 

Low 

Low 

153 

221 

226 

Low 

Mid 

158 

226 

230 

Low 

High 

159 

226 

230 

High 

Low 

166 

241 

267 

High 

Mid 

173 

249 

273 

High 

High 

180 

254 

274 
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b.  It  must  be  reemphasized  that  the  extent  and  patterns  of  error 
actually  present  in  the  fundamental  data  collected  in  Experiment  11.8 
are  unknown  and  that  there  is  no  objective  means  to  estimating  this  in- 
formation, short  of  reexecution  of  the  experiment.  Thus,  while  this 
ana  ,', is  provides  an  indication  of  the  effect  some  hypothetical  error 
p..t  .erns  could  have  on  the  derived  variables,  actual  error  trends  in  the 
available  data  remain  open  to  conjecture. 

B-5.  CONCLUSIONS. 

a.  Intervisibility  segment  descriptors  can  be  highly  sensitive  to 
relatively  low  error  rates  within  the  fundamentcl  data  used  to  develop 
these  descriptors. 

b.  The  degree  of  sensitivity  of  intervisibility  segment  descriptors 
to  errors  in  the  fundamental  data  depends  primarily  on  the  patterns  in 
which  these  errors  may  occur,  not  on  the  relative  number  of  errors. 

c.  Probability  of  line-of-sight  measures  are  not  highly  sensitive 
to  moderate  error  rates  in  the  fundamental  data. 


d.  The  degree  of  sensitivity  of  P^qc  measures  to  errors  in  the  funda- 
mental data  depends  upon  the  amount  of  error  in  the  data.  Error  patterns 
are  of  relatively  minor  importance  in  determining  this  level  of  sensitiv- 
ity. 
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PREPARATION  OF  FIELD  DATA 

C-1.  GENERAL.  During  the  early  stages  of  the  study  it  was  envisioned 
that  preparation  of  the  field  experiment  data  for  the  model  comparison*, 
would  be  a relatively  straightforward  undertaking  requiring  only  the 
accomplishment  of  the  following  tasks:  obtaining  intervisibility  iita 
from  CDEC  in  some  suitable  automated  form;  editing  these  automatt : data 
to  eliminate  the  minor  inconsistencies  that  sometimes  accompany  trans- 
mission of  large  amounts  of  data;  finally,  reformatting  these  data  to 
facilitate  their  use  with  similar  data  produced  by  the  three  models. 
However,  unexpected  difficulties  in  obtaining  these  data  in  an  automated 
form  suitable  for  use  on  TRADOC  Control  Data  Corporation  6500  computer 

at  Fort  Leavenworth  and  the  discovery  of  a number  of  anomalies  in  the 
data  provided  by  CDEC  expanded  this  task  into  a sizeable  undertaking. 

The  purpose  of  this  appendix  is  to  describe  the  nature  and  extent  of 
these  problems  and  to  describe  the  extent  to  which  they  were  resolved. 

C-2.  DATA  PROCUREMENT.  The  field  experiment  data  were  originally  re- 
corded on  specially  labeled  and  perforated  "port-a~punch"  cards  issued 
to  the  collection  teams  in  the  field.  These  data  were  subsequently 
edited  on  a General  Electric  605  computer  at  CDEC  and  were  provided  to 
the  study  team  on  a magnetic,  card-image  tape.  A full  description  of 
the  organization  of  this  data  file  is  contained  in  Volume  V,  CDEC  Final 
Report  on  Experiment  11.8.  The  study  team  was  unable  to  process  on  the 
TRADOC  Control  Data  Corporation  computer  a series  of  intervisibility 
data  tapes  provided  by  CDEC  during  the  period  June  to  November  1973  due 
to  apparent  hardware  incompatibility  between  the  two  computer  systems. 

For  this  reason,  a study  team  representative  traveled  to  CDEC  and  ob- 
tained on  punch  cards  the  intervisibility  data  for  the  Hunter-Liggett 
sites.  Shortly  thereafter,  the  tape  compatibility  problem  was  solved. 

(It  was  traced  to  special  file  marks  and  blocking  characteristics  created 
by  the  GE  605  computer  that  required  special  handling  on  the  Control  Data 
Corporation  computer.)  Since  work  had  already  begun  in  editing  and  re- 
formatting the  punch  card  data  by  the  time  the  tape  problem  was  resolved, 
the  card  data  were  selected  for  use  in  the  study. 

C-3.  DATA  REFORMAT.  A revision  of  the  CDEC  file  structures  and  data 
formats  was  desirable  for  model  verification  for  several  reasons.  First, 
it  became  obvious  that  a number  of  modifications  to  each  model  would  be 
necessary  in  order  to  extract  the  detailed  intervisibility  data  needed 
for  evaluating  model  performance.  Thus,  it  was  necessary  to  establish 
a single,  suitable  format  for  model  output  data  and  to  begin  this  model 
modification  work  at  the  earliest  practicable  date.  Second,  it  was  also 
obvious  that,  in  the  interest  of  quality  assurance  during  model  verifica- 
tion, data  from  the  field  experiment  and  the  three  models  should  be 
stored  in  a common  format.  The  use  of  a common  format  for  intervisi- 
bility data  from  all  four  sources  would  reduce  the  difficulties  in  edit- 
ing these  data  and  would  provide  for  the  use  of  a single  set  of  computer 


C-1 


.V.  . 


proqranis  for  the  analysis  and  comparison  of  the  several  sets  of  data. 
Finally,  it  was  determined  that  the  format  used  by  CDEC  for  storing 
intervisibility  data  was  too  highly  compacted  for  use  by  the  models. 

For  these  reasons,  a new  set  of  formats  and  a new  file  structure  were 
developed  and  utilized.  These  are  described  in  table  C-1.  During  re- 
vision of  the  CDEC  data  structure,  a number  of  anomalies  in  the  field 
experiment  data  were  discovered. 

C-4.  NATURE  AND  EXTENT  OF  DATA  ANOMALIES.  These  data  problems  necessi- 
tated a series  of  manual  and  computer-assisted  edits  of  the  data  origin- 
ally obtained  on  punched  cards.  These  edits  resulted  in  the  identifica- 
tion of  a number  of  "illegal"  data  codes  scattered  through  the  data 
collected  on  both  the  experimentation  sites  at  Hunter-Liggett.  In  an 
effort  to  resolve  these  inconsistencies  in  the  punch  card  data,  the 
study  team  examined  the  intervisibi’ity  data  contained  on  the  magnetic 
tape.  Similar  anomalies  existed  in  the  magnetic  tape  data,  and  there 
were  also  differences  in  the  amount  and  content  of  data  between  the 
card  and  tape  files.  A summary  of  the  nature  and  extent  of  these  data 
anomalies  follows. 

a.  £DEC  Data  Structure.  A jeneral  knowledge  of  the  organization  of 
codes  usecPfbr  We  field  d¥ta  is  required  in  order  to  understand  the 
data  problems  themselves.  Intervisibility  data  provided  to  the  study 
team  by  CDEC  consisted  of  two  sets  of  punched  cards  for  each  of  the 
Hunter-Liggett  site/ tactic  combinations.  The  first  set,  the  LOS  cards, 
consisted  of  one  ca.'d  for  each  stake  and  contained  coded  data  indicating 
whether  line  of  sight  existed  and,  wherever  appropriate,  the  reasons  for 
nonexistence  of  line  of  sight  from  that  stake  to  each  of  the  36  defender 
positions  (panels)  for  each  of  6 height  combinations.  The  second  set, 
the  survey  cards,  contained  the  10-digit  UTM  coordinates  of  each  defen- 
der position  and  of  selected  stakes  on  each  of  the  attacker  routes.  An 
example  of  an  LOS  card  is  shown  at  figure  C-1.  Card  columns  9-44  and  45 
80  on  the  LOS  cards  contain  coded  data  describing  the  amount  of  each 
defender  panel  visible  from  that  stake  for  the  low  and  high  attacker 
heights,  respectively.  In  any  one  card  column,  the  intervisibility 
conditions  existing  between  a stake  and  a single  defender  weapon  are 
specified  by  punches  in  the  particular  zones  and  rows  of  that  column. 

b.  Legal  Combinations.  A complete  list  of  the  authorized  punches 
and  their  meaning  is  shown  in  table  C-1.  Examination  of  these  codes  and 
thei r meanings  indicates  that  only  certain  combinations  of  these  punches 
should  appear  together  in  any  one  card  column.  The  complete  set  of 
"legal"  combinations  of  these  row  punches  is  contained  in  table  C-2. 

All  other  combinations  result  in  illegal  combinations  which  are  incom- 
plete, ambiguous,  or  contradictory. 

c.  Illegal  Code  Combinations.  Editing  of  the  field  data  identified 
the  presence  of  a numEer'  of  illegal  code  combinations.  These  combina- 
tions generally  fell  into  one  of  three  categories,  each  of  which  is 
described  below  in  order  of  increasing  importance. 
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Table  C-1 . Intervisibility  Codes  for  Field  Data  Cards 


Card 

Zone  Punch 

Meaning 

12 

Can  see  top  band  only 

11 

Can  see  top  two  bands  only 

0 

Can  see  all  bands 

None 

No  bands  visible 

Card 

Row  Punch 

1 

Not  used 

2 

Terrain  interrupts  LOS 

, 3 

Vegetation  interrupts  LOS 

4 

Cultural  feature  interrupts  LOS 

5 

Unknown  reason  for  no  LOS 

6 

Not  used 

7 

Not  used 

8 

Looking  through  trees  (Site  B only) 

9 

Not  used 

None 

No  given  reaso*-  ir  interruption  of 

LOS 

Table  C-2.  Legal  Combinations  of  LOS  Data  Codes 


Si  tc 

A 

Site 

B 

Zone-Rcvj 

Character 

Zone-Rov.' 

Character 

b - b 

Same  as 
character 
to  the  left 

b - b 

Same  as 
character 
to  the  left 

b - 2 

2 

b-8-2 

« 

b - 3 

3 

b-8-3 

s 

b - 4 

4 

b-8-4 

II 

b - 5 

5 

b-8-5 

0 

12-2 

B 

12-8-2 

< 

12-3 

C 

12-8-3 

« 

12-4 

D 

12-8-4 

) 

12-5 

E 

12-8-5 

\ 

11-2 

K 

11-8-2 

! 

11-3 

L 

11-8-3 

$ 

11-4 

M 

11-8-4 

it 

11-5 

N 

11-8-5 

0-b 

0 

P-8 

Y 
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(1)  Incomplete  code  combinations.  A problem  existed  when  one 
punch  in  a column  meant  necessarily  that  another  punch  should  appear  but 
iv.  in  fact  did  not.  For  example,  the  presence  of  a 12-punch  indicated 
tiiot  only  the  top  color  band  is  visible  and  implies  that  an  additional 
pun>,;i  should  appear  indicating  the  reason  that  the  remaining  bands  could 

I not  I seen.  Since  only  limited  use  was  made  of  the  recorded  reasons 

for  tne  nonexistence  of  LOS  during  the  model  work,  the  existence  of 
errors  of  this  type  was  not  considered  serious.  However,  they  do  indi- 
cate that  on-site  editing  of  field  data  may  have  been  incomplete,  or  that 
the  data  compaction  (or  some  other)  process  introduced  errors  to  the  data 
i base. 

(2)  Contradictory  code  combinations.  The  second  most  frequently 
encountered  type  of  data  anomaly  was  the  existence  of  two  or  more  punches 
in  a column  that  contradicted  one  another.  One  example  of  this  type  of 
error  is  a column  containing  the  0-3  punches.  According  to  table  C-1, 
this  code  means  that  all  color  bands  could  be  seen  but  that  vegetation 

! obstructed  vision  to  those  bands  which  could  not  be  seen--an  obvious 

contradiction.  This  type  error  is  particularly  serious  for  two  reasons. 
First,  there  is  a real  question  as  to  whether  LOS  did  or  did  not  exist 
in  these  cases.  Second,  this  type  of  problem  occurred  more  than  600 
times  in  the  data  for  the  HLMR  sites. 

(3)  Blank  column.  The  final  and  most  critical  problem  was  the 

existence  of  numerous  blank  columns  in  the  LOS  data.  According  to  the 

CUEC  data  coding  scheme,  the  absence  of  a zone  punch  (12,  11,  or  0 ounch) 
in  any  coliran  indicated  that  none  of  the  color  bands  could  be  seen  and 

it  should  therefore  be  accompanied  by  an  appropriate  row  punch.  How- 
ever, more  than  100,000  blank  columns  existed  in  the  HLMR  data  with  no 
fewer  than  32,000  of  these  occurring  for  any  one  site/tactic  combination. 
During  the  attempt  to  resolve  this  problem,  the  study  team  was  referred 
to  Braddock,  Dunn  and  McDonald  Scientific  Support  Laboratory  personnel 
f who  participated  in  the  collection  and  subsequent  processing  of  these 

j data.  BOM  analysts  indicated  that  under  certain  circumstances,  the  data 

collection  teams  were  permitted  to  use  blanks  on  the  port-a-punch  cards 
to  indicate  repetition  of  the  first  entry  on  each  card.  For  example, 
in  the  case  where  line  of  sight  was  obstructed  to  all  36  panels  by  land- 
form,  the  data  recorder  was  instructed  to  record  this  information  only 
for  the  first  defender  position  and  leave  the  rest  of  the  columns  blank. 
Subsequent  examination  of  the  patterns  in  which  blanks  appeared  in  the 
data  showed  this  interpretation  of  blank  columns  to  be  reasonable  in 
most  instances  but  highly  suspect  in  some.  It  is  more  likely  that  the 
many  random  occurrences  of  isolated  blanks,  or  small  groups  of  blanks 
scattered  throughout  the  data,  indicated  missing  data  rather  than  ef- 


forts to  improve  the  efficiency  of  data  collection.  In  some  cases,  i ^ 

blanks  were  also  discovered  in  the  card  columns  corresponding  to  the  \ ) 

first  defender  position.  Again  the  existence  of  these  problems  indi- 
cated  a possible  data  editing  or  compaction  problem.  1? 


(4)  Extent  of  code  amonalles.  A breakdown  of  the  number  of 
occurrences  of  illegal  code  combinations  of  each  type  is  contained  in 
table  C-3.  The  amount  of  anomalous  data  found  for  the  two  tactics  on 
Site  A is  less  than  1 percent  of  the  total  data  collected  there,  while 
the  Site  B data  contained  several  times  as  many  anomalies  as  were  con- 
tained in  the  two  sets  of  data  for  Site  A. 

d.  ^nomaljes  in  Survey  DaU ♦ In  addition  to  the  discrepancies  in 
the  LOS  carcTs  descrlbeT" above , anomalies  were  also  found  in  the  survey 
cards  themselves  and  in  attempting  to  match  each  survey  card  with  its 
corresponding  LOS  card.  These  discrepancies  were  of  three  general  types, 
each  of  which  is  described  in  succeeding  subparagraphs.  These  anon)alies 
are  considered  serious  only  insofar  as  they  may  indicate  inadequate 
quality  assurance  primarily  in  editing  the  field  data.  Once  these  errors 
were  discovered,  the  necessary  corrective  action  became  obvious. 

(1)  Redundant  survey  cards.  More  than  one  survey  card  existed 
for  32  stakes  on  Site  B.  In  each  case,  the  UTM  coordinates  contained 
on  the  redundant  survey  cards  differed  by  several  meters. 

(2)  Shifted  fields.  The  10-digit  coordinates  of  the  36  de- 
fender weapon  positions  on  both  sides  were  found  to  be  shifted  one 
column  to  the  left  of  their  proper  field,  as  they  had  erroneously  been 
multiplied  by  a factor  of  10.  This  problem  occurred,  in  groups,  on 
more  than  280  of  the  stake  survey  cards  for  Site  A (Covered  Approach). 

(3)  Unpaired  cards.  Survey  cards  were  found  for  which  no  cor- 
responding LOS  cards  existed,  and  LOS  cards  were  found  at  the  end  of  a 
path  for  which  no  survey  card  existed.  This  situation  provides  LOS 
data  for  a point  on  the  battlefield  the  location  of  which  is  not  known. 

e.  Discrepancies^  Between  Card  and  Tape  Files.  The  intervisibility 
data  on  ^Re* magnetic  tape  were  examTned "Wan  effort  to  resolve  the 
anomalies  discovered  in  the  punch  card  data.  This  investigation  dis- 
closed that  anomal ies  similar  to  those  in  the  punch  card  data  also 
existed  in  the  magnetic  tape  data,  that  a number  of  differences  existed 
betv/een  the  tape  and  punch  card  files,  and  that  the  punch  card  file 
contained  a considerable  amount  of  data  not  included  in  the  magnetic 
tape  file. 

C-5.  CORRECTION  OF  DATA  ANOMALIES.  As  each  of  the  various  types  of 
data  problems  was  discovered,  an  attempt  was  made  to  resolve  it  through 
discussions  with  appropriate  personnel  at  CDEC.  During  this  process, 
it  became  obvious  to  the  study  team  and  the  CDEC  analysts  that  some  of 
these  problems  could  not  be  resolved  satisfactorily  without  a compre- 
hensive and  time-consuming  review  of  the  original  field  data.  Because 
these  data  anomalies  were  found  to  be  present  in  a relatively  small 
percentage  of  the  field  data,  it  was  decided  that  the  study  team  should 
resolve  these  data  problems  as  best  it  could  and  proceed  with  the  model 
comparisons,  being  careful  to  avoid  reliance  on  comparison  methods 
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Table  C-3.  Summary  of  Illegal  Characters  in  LOS  Data  File 


1 

1 

llol  1eri  th 
Cha>\ic*cor 

Zono/Row 

i\incli 

Site  A 
(Covered) 

Si  to  A 
(Rapid) 

Site  B 

H 

12-8 

0 

0 

8 

Q 

11-8 

0 

0 

12 

S 

0-2 

52 

23 

0 

T 

0-3 

127 

53 

376 

U 

0-4 

0 

0 

1 

V 

0-5 

5 

9 

0 

8 

8 

0 

0 

65 

+ 

12 

5 

2 

54 

- 

11 

34 

34 

54 

J 

0-8-3 

0 

0 

3487 

( 

0-8-4 

0 

0 

8 

Random* 

Blai\ks 

None 

266 

291 

510 

TOTALS 

489 

412 

4576 

of  Total  LOS 
Data  in  Lrror 

1 r' 

p • 

~ 4". 

*Found  in  groups  of  less  than  35  columns  in  a row. 


overly  sensitive  to  errors  in  the  field  data.  The  study  team's  approach 
to  correctinq  these  problems  thus  became  one  of  attempting  to  identify 
and  implement  the  most  reasonable^  and  logical  interpretation  of  incom- 
plete, ambiguous,  or  con tra'dl cTory  dataT  in  those  cases  where  resolution 
based  upon  field  experiment  reality  was  not  feasible.  Specific  correc- 
tions of  each  of  the  various  types  of  data  anomalies  are  outlined  below. 

a.  LOS  Data  Corrections.  In  attempting  to  resolve  problems  in  the 
actual  ITne'-of-si^t  data,  greater  weight  was  placed  upon  data  describ- 
ing whether  LOS  existed  than  was  placed  on  data  recording  the  reasons 
for  nonexistence  of  LOS,  for  several  reasons.  First  the  collection  of 
data  describing  the  frequency  and  duration  of  LOS  was  the  main  objective 
of  the  field  experiment.  Second,  quality  control  procedures  implemented 
during  the  conduct  of  the  field  experiment  were  limited  to  checks  on  the 
accuracy  of  the  "YES-NO"  LOS  data.  Finally,  for  the  purposes  of  evalua- 
ting model  performance,  only  these  fundamental  LOS  data  were  used  to  any 
great  extent,  since  the  data  collected  as  to  the  reasons  for  nonexistence 
of  LOS  were  the  recorded  judgments  of  the  data  collectors  and  no  esti- 
mates as  to  the  reliability  of  these  data  were  possible.  Thus,  the 
greatest  emphasis  in  attempting  to  resolve  these  data  problems  was 
placed  on  determining  whether  LOS  existed,  and  these  fundamental  data 
were  normally  considered  more  reliable  than  other  data  where  contradic- 
tions existed. 

(1)  Incomplete  code  combinations.  In  those  cases  where  one 
or  more  of  the  color  bands  on  a panel  could  not  be  seen  but  no  reason 
was  given  for  tlie  nonexistence  of  LOS,  the  number  of  colors  visible  was 
accepted  and  the  fact  that  no  reason  was  recorded  was  Ignored. 

(2)  Contradictory  code  combinations.  Where  the  9-zone  punch 
(entire  panel  visible)  was  accompanied  by  one  or  more  row  punches,  the 
LOS  data  (zone  punch)  were  assumed  correct  and  the  row  punches  ignored. 

(3)  Blank  columns.  Blank  entries  in  the  LOS  data  presented  a 
special  problem  as  many  of  these  appeared  to  represent  missing  LOS  data 
rather  than  abbreviated  procedures  for  data  collection.  This  matter  was 
discussed  with  personnel  at  CDEC  (HLMR)  and  their  solution  was  to  assume 
that  the  intervisibility  status  of  the  column  inmediately  to  the  left 
pertained.  The  study  team  adopted  this  procedure  because  it  was  as  good 
as  any  other  for  filing  in  what  appeared  to  be,  in  many  cases,  missing 
data.  It  was  recognized,  however,  that  a simple  decision  rule  cannot 

be  expected  to  replace  field  experiment  reality  and  that  adoption  of 
such  a rule  is  done  arbitrarily.  (The  study  team  considered  the  use  of 
this  procedure  to  be  a matter  of  some  concern  until  preliminary  model 
results  showed  that  differences  between  the  models  and  the  field  experi- 
ment were  much  greater  than  differences  that  could  be  attributed  to  th^j 
use  of  this  arbitrary  rule.)  In  some  cases,  the  leftmost  column  of  a 
card  was  also  blank,  in  which  case  the  data  on  preceding  and  subsequent 
cards  and  for  the  other  height  combinations  were  manually  reviewed  and 


C-9 


u juOiinient  made  as  to  tl'.e  most  reasonable  entry.  The  problem  of  leadinq 
blanks  was  encountered  and  resolved  In  tl»1s  way  about  a dozen  times  in 
all . 


Surve;^  Data  CorrccU^s.  The  types  of  anomalies  found  in  the 
.urvt  y daYa'werc'mucFrTej’s “serious  than  those  in  the  LOS  data.  The 
Lnrn.'  general  types  of  corrections  made  to  the  survey  data  are  as  fol 
lows : 


(1)  Redundant  survey  cards.  The  problem  of  extra  survey  cards 
was  resolved  by  usinq  the  coordinates  on  the  second  card  in  sequence  in 
all  cases. 

(2)  Shifted  fields  on  survey  cards.  These  fields  were  shifted 
one  decimal  place  to  the  right  by  machine.  It  appeared  that  some  inter- 
mediate processing  of  the  CDEC  data  had  caused  these  shifts,  but  no 
attempt  was  made  to  discover  just  where  the  data  shifts  were  introduced. 

(3)  Unpaired  cards.  Cards  that  did  not  have  a corresponding  LOS 
or  survey  card  were  removed  from  the  data  file  by  hand. 

c.  Discrepancies  Between  Card  and  Tape  Files.  Following  the  discovery 
that  the  punch  "card' ' "fTTe  contained  considerably  nore  data  than  the  tape 
file,  no  further  attempt  was  made  to  use  the  tape  file  data  in  resolving 
data  anomalies  and  no  attempt  was  made  to  correct  anomalies  in  the  tape 
file. 


C-6.  QUALITY  ASSURANCE.  During  the  process  of  preparing  the  field  experi- 
ment data  for  use  in  the  model  comparisons,  it  became  obvious  that  a check 
on  the  work  performed  was  necessary  in  the  interest  of  quality  assurance. 
The  complete  revision  of  the  intervisibility  data  structure,  the  correc- 
tion of  anomalies  in  these  data,  and  the  development  at  CACDA  of  a sub- 
stantial amount  of  computer  software  for  handling  these  data  all  were  tasks 
which,  if  performed  incorrectly,  could  have  introduced  errors  into  the 
baseline  that  would  have  been  difficult  to  detect.  Thus,  it  was  decided 
that  the  accomplishment  of  one  final  task  was  necessary  to  insure  that  no 
errors  had  been  introduced  during  the  transformation  and  that  the  struc- 
ture of  the  intervisibility  data  had  not  been  altered  by  the  correction 
of  anomalies.  The  summaries  of  intervisibility  data  presented  in  Volume 
IV  of  CDEC  final  report  on  Experiment  11.8  and  the  CDEC  computer  program 
through  which  these  summaries  were  derived  provided  the  study  team  with 
the  means  for  accomplishing  these  two  objectives. 

a.  Initial  Comparison.  In  an  effort  to  verify  che  new  data  structure 
and  the  data  handling  anT'analysis  software,  the  corrected  data  were  pro- 
cessed by  the  CACDA  software  to  produce  summaries  of  these  data  similar  to 
those  presented  in  Volume  IV  of  the  CDEC  final  report.  The  procedui'es 
leading  to  these  comparisons  are  shovm  in  the  schematic  at  figure  C-2.  A 
comparison  of  these  summaries  showed  a number  of  differences  between  the 


C-10 


IW^IPSTS' 


two  in  terms  of  both  the  number  of  line-of-sight  segments  end  the  distri- 
b:  .ions  of  segment  lengths.  These  differences  appeared  to  be  relatively 
I'll  or  on  Site  A but  v/ere  much  more  serious  on  Site  B.  It  was  not  clear 
wi.'  Uior  these  differences  should  be  attributed  to  differences  between  the 
Corrected  and  uncorrected  data  or  to  differences  between  the  CDEC  and 
CACDA  software. 

b.  ^^cific  AeJUon^.  Two  specific  actions  were  initiated  in  an 
attempt  to  iHentify  tWe  source  of  these  differences.  A detailed  review 
of  the  CACDA  data  handling  and  analysis  software  was  performed,  but  this 
review  merely  verified  that  the  newly  developed  procedures  appeared  to 
be  sound.  Therefore,  a thorough  review  of  the  logic  of  the  computer 
program  provided  by  CDEC  was  undertaken.  This  investigation  provided 
CACDA  analysts  with  a better  understanding  of  the  way  the  various  data 
anomalies  were  handled  during  the  automated  data  processing  operations 
that  produced  the  CDEC  final  report  and  further  indicated  that  differ- 
ences observed  could  easily  have  resulted  from  the  different  treatments 
of  data  anomalies.  For  this  reason,  a more  detailed  inve  .tigation  of 
the  treatment  of  anomalous  data  appeared  to  be  necessary. 

c.  Further  Investigation . A series  of  alternative  treatments  of 
the  data  anomaTi es  were  Thvesti gated  using  various  combinations  of  the 
corrected  and  uncorrected  data  sets  and  the  CACDA  and  CDEC  analysis  pro- 
grams. Because  differences  observed  in  Site  B were  much  more  pronounced 
than  those  for  Site  A,  this  investigation  was  confined  to  the  Site  B data. 
A summary  for  the  numbers  of  line-of-sight  segments  produced  by  various 
treatment  is  shown  at  table  C-4.  The  results  of  this  investigation  are 
summarized  below; 

(1)  When  the  CACDA  and  CDEC  analysis  programs  were  used  in  con- 
junction with  the  corrected  data  set,  they  produc'^d  identical  results. 

It  was  therefore  concluded  that  differences  in  results  produced  by  the 
two  programs  resulted  from  different  treatments  of  the  anomalous  data 
and  that  the  CACDA  softv^are  was  operating  correctly. 

(2)  None  of  the  various  treatments  successfully  reproduced  the 
presentations  of  results  included  in  the  CDEC  final  report.  Moreover, 
each  of  the  various  treatments  produced  significantly  more  line-of-sight 
segments  in  most  range  bands  than  was  reported  by  CDEC . The  study  team 
could  not  identify  any  treatment  of  the  various  data  anomalies  that 
could  have  produced  as  few  LOS  segments  as  reported  by  CDEC  from  the 
LOS  data  provided. 

(3)  It  was  concluded  that  the  CACDA  software,  when  used  in  con- 
junction with  the  corrected  data  set,  produced  LOS  segment  data  that 
were  at  least  as  reliable  as  those  available  from  the  other  sources  and 
that  no  substantial  improvement  in  this  situation  would  occur  prior  to 
final  resolution  of  the  various  data  anomalies  at  CDEC.  It  was  there- 
fore decided  that  the  corrected  LOS  data  and  CACDA  software  should  be 
accepted  as  the  baseline  for  model  verification  purposes. 
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C-7.  SUMMARY  OF  PRINCIPAL  FINDItlGS.  The  principal  findings  and  results 
of  the  work  performed  in  preparing  the  field  experiment  data  may  be  sum- 
marized as  follows: 

a.  The  intorvisibility  data  provided  to  the  study  team  contained 
anomalous  data  of  various  types.  The  study  team,  with  tlie  assistance 
of  analysts  at  CDEC,  identified  and  implemented  corrections  to  these 
anomalous  data  which  were,  in  many  cases,  based  upon  study  team  judg- 
ments as  to  most  reasonable  treatment.  The  extent  to  which  these  cor- 
rections reflect  field  experiment  reality  is  unknown. 

b.  An  examination  of  the  effects  on  intervisibility  of  several  alter- 
■ative  treatments  of  the  various  types  of  anomalous  data  was  performed 

in  order  to  insure  that  errors  had  not  been  introduced  into  the  baseline 
during  the  process  of  revising  the  data  structure  and  developing  project 
software.  It  was  concluded  that  tb.  software  developed  by  the  study  team 
was  operating  correctly  and  that  thx.  intervisibi lity  data  produced  by 
this  software  using  the  corrected  LOS  data  sets  should  be  accepted  as 
the  baseline  data  for  model  verification  purposes  even  though  informa- 
tion derived  from  these  data  (e.g.,  number  of  LOS  segments)  was  at  vari- 
ance with  that  presented  in  the  final  report  on  the  field  experiment. 
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lUA  LOCATIOll  DATA 

U-1.  GENERAL.  In  attempting  to  verify  nx)de1  intervisibility  calculations, 
it  was  necessary  to  reproduce  in  the  models  the  locations  of  36  ATM  tar- 
get panels  and  the  locations  of  approximately  200  viewing  points  on  each 
of  10  approach  routes  for  the  ttiree  situations  considered.  Exact  repro- 
duction of  approach  route  points  was  impractical  for  both  lUA  and 
CARMONETTE.  Additionally,  for  ILIA,  reproduction  of  ATM  panel  locations 
was  a moot  issue  since  intervisibility  calculations  in  ILIA  are  carried 
out  to  objective  points  rather  than  to  discrete  defensive  target  posi- 
tions. The  treatment  of  these  problems  is  discussed  in  this  appendix. 

D-2.  SELECTION  OF  APPROACH  ROUTES. 

a.  Problem.  Given  a set  of  approximately  200  UTM  coordinates  de- 
scribing" an  approach  route,  it  was  necessary  to  select  30  or  fewer  points 
which,  in  some  sense,  provided  a "best"  representation  of  the  route. 

(The  maximum  number  of  points  accepted  for  direct  input  to  lIJA  in  de- 
scribing one  route  is  30.)  The  resulting  points  were  also  used  for 
CARMONETTE,  which  could  not  differentiate  intervisibility  differences 
between  points  in  the  same  100-meter  square  terrain  cell.  It  was  decided 
that  the  start  and  end  points  of  each  model  route  should  correspond  with 
those  of  the  field  routes  and  that  the  30  model  points  should  be  a sub- 
set of  tlie  field  points. 

b.  Selection  Criterion.  The  criterion  chosen  to  measure  the  fidelity 
of  tiio  model  route  to  the  actual  route  was  tlie  sum  of  squared  deviations 
(SSU)  of  the  field  (surveyed)  points  from  the  model  route.  In  this  con- 
text, deviation  was  defined  as  the  shortest  distance  from  the  field  point 
to  its  corresponding  line  segment  of  the  model  route.  Figure  D-1  illus- 
trates one  segment  of  an  lUA  model  route  with  several  intermediate  field 
points  lying  off  tiie  route.  The  sum  of  squared  deviations  (SSD)  associ- 
ated with  this  leg  of  the  model  route  would  be  computed  as  follows: 


127 

^^*^(123,127)  “ Z)(dev^)^ 

i = 123 


= (0)2  + (lb)2  + (5)2  + (10)2  + (0)2 
= 350  meters2 

To  determine  the  SSD  for  a proposed  model  path,  this  computation  would 
be  performed  over  the  entire  path. 
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c.  Selection  Procedure . The  problem  then  was  to  select  30  or  fewer 
points  from  the  field  data  points  describing  an  optimal  model  path;  i.e., 
one  having  the  smallest  SSD.  A dynamic  programing  procedure  was  used 
to  solve  this  problem.  The  algorithm  starts  at  the  beginning  of  the  field 
route  and  moves,  point  to  point,  toward  the  end  of  the  route.  At  each 
point  an  optimal  model  path  segment  is  calculated  from  that  point  to  the 
beginning  of  the  field  route.  The  optimal  model  segments  are  then  used 
in  the  construction  of  an  optimal  model  path  along  the  entire  route.  As 
an  example,  consider  field  trail  point  123  in  figure  D-1.  The  algorithm 
assumes  that  point  123  will  be  on  the  optimal  model  path.  However,  since 
the  number  of  model  points  that  will  be  selected  for  the  final  optimal 
path  between  point  123  and  1 is  unknown,  the  SSD  must  be  generated  for 
all  possible  model  segments.  Table  D-1  presents  an  abbreviated  table  of 
data  generated  to  describe  optimal  model  path  segments  from  field  point 
123  to  field  point  1.  From  the  table,  it  will  be  noted  that  segment 
123'^74  “‘‘I  is  the  optimal  three-point  segment  from  123  to  1 since  it 
has  tiie  smallest  SSD.  This  model  path  segment  will  be  a part  of  any 
optimal  path  having  a three-point  segment  between  123  and  1.  After  all 
optimal  segments  containing  4 points,  5 points,  ...  up  to  29  points  have 
been  generated  between  point  123  and  1,  the  algorithm  will  move  to  point 
124.  Optimal  segment  calculations  at  this  point  are  simplified  by  the 
use  of  optimal  segments  from  the  previous  points.  The  algorithm  continues 
until  it  reaches  the  final  point  of  the  field  data.  At  this  stage,  it 
w'll  have  generated  a set  of  optimal  model  paths  over  the  entire  field 
route  containing  from  2 to  30  points.  The  30-point  optimal  path  was 
*;c;lected  the  lUA  path  simulating  the  field  route.  The  extent  of  de- 
k-iation  each  of  the  30  selected  paths  from  the  field  data  is  shown 

at  table  D-2. 

D-3.  OBJECTIVE  ASSIGNMENTS. 

a.  Problem.  For  intervisibility  calculations,  IDA  requires  that 
each  defender  position  be  associated  with  an  attacker  route  objective 
point.  Further  routes  may  be  grouped  into  up  to  three  axes.  Intervis- 
ibility calculations  are  actually  made  to  objective  points  and  the 
result  applied  to  associated  targets.  Thus,  it  was  necessary  to  define 
objective  joints  d to  assign  each  ATM  position  to  an  objective  point. 

b.  Procedure.  Route  objective  points  were  placed  on  the  centers  of 

mass  of  groups  of  panels  that  appeared,  by  map  inspection,  to  be  located 
near  the  end  points  of  paths.  This  approach  was  consistent  with  the 
manner  in  which  a •'’r  would  be  expected  to  select  objective  points  based 
on  lUA  documentat.  , Axes  were  chosen  by  grouping  together  paths  that 

were  closely  locr?  -d.  The  maximum  number  of  paths  on  any  one  axis  was 
five.  In  most  cases  this  axis  selection  is  largely  arbitrary  since  the 
paths  are  fairly  evenly  distributed  across  the  terrain  they  traverse. 

Axis  objective  points  were  then  placed  on  the  centers  of  groups  of  panels 
associated  with  the  particular  axis.  Coordinates  of  axis  and  route  ob- 
jective points  and  associated  target  panels  are  contained  in  table  D-3. 
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Table  D-1.  Calculations  for  Optimal  Model  Path  Segments 
From  Field  Points  123  and  124  to  Field  Point  1 


Table  D-2.  Deviation  of  lUA  Paths  from  Field  Experiment  Routes 
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Table  D-3.  Objective  Points  and  Panel  Groupings 


Site 

(Tactic) 

T 

Axis  Number  • 
Objective  Point 

■ 

Route  Number  - 
Objective  Point 

Defender 
Panels  Assigned 

ALPHA 

(Rapid) 

11  - 55697788 

1 - 55517773 

2 - 55367798 

3 - 55867780 

(4)»  (5) 

(1),  (3).  (6).  (7),  Y,  Z 
S,  U,  X,  Y 

12  > 56407790 

4 - 56197807 

5 - 56337773 

6 - 56547766 

7 - 56467803 

T 

P,  Q,  R. 

0.  E.  G,  H»  J.  M 

L 

#3  - 56907785 

8 - 56747770  ‘ 

9 - 56777791 
10  - 57207773 

6»  A»  B 
5,  7.  8.  9.  L 
1.  2.  3.  4 

1 

ALPHA 

(Covered) 

n - 55707770 

1 - 55517773 

2 - 55647790 

iii;  (6).  (7)r^v 

W,  X.  Y»  Z 

#2  - 56567767 

3 - 55937812 

4 - 56427771 

5 - 56567767 

6 - 56737791 

7 - 56717785 

T 

G.  H.  J.  P.  Q.  R 
0,  E ' 

K,  M 

A,  B,  C,  L 

#3  - 57007760 

8 - 56777792 

9 - 56917780 
10  - 57207773 

8,  9 
5,  6,  7 
1,  2,  3.  4 

BRAVO 

(Rapid) 

11  - 5*:488222 

1 - 52438232 

2 - 52178214 

S,  T,  U,  W.  X.  Y,  Z 
R 

#2  - 52188178 

3 - 52088202 

4 - 52018201 

5 - 51978197 

6 - 51908179 

7 - 51908172 

Hi:  !!!• 

(7),  0,  K.  L.  M 
E»  6,  H 
At  B|  C,  Dt  6 

#3  - 52118124 

8 - 51708167 

9 • 52118121 
10  - 51398158 

7,  9 

1.  2,  3.  4,  5 
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LESSONS  LEARNED 

t-1.  GENERAL.  In  performing  the  work  described  in  this  report,  the 
study  team  learned  a number  of  lessons  ♦'elated  to  the  preparation,  appli- 
cation, and  validation  of  the  three  models.  These  lessons  are  Included 
here  in  the  hopes  that  their  reporting  might  in  some  way  benefit  current 
and  prospective  model  users  and  their  work.  These  lessons  fall  generally 
into  two  categories:  those  general  lessons  that  might  benefit  study  team 

leaders,  study  managers,  and  other  decision  makers  and  those  lessons  in 
the  details  of  model  preparation,  operation,  and  maintenance  that  might 
assist  model  teams  in  preparing  and  running  these  models  in  the  future. 

E-2.  LESSONS  IN  MODEL  PREPARATION.  The  principal  lessons  of  general 
interest  in  preparing  the  three  models  for  an  application  are  related  to 
the  preparation  of  terrain  data. 

a.  Requirement  for  Real  World  Terrain.  There  are  no  two  general 
schools  of  thought  on  the  requirement  for  having  in  the  models  terrain 
data  that  accurately  describe  specific  real  world  terrain  sites  (likely 
battlefields)  as  opposed  to  terrain  data  describing  nonexistent  but  os- 
tensibly representati ve  (theoretical)  terrain.  Both  schools  were  repre- 
sented on  the  study  team,  and  disagreement  as  to  whether  there  actually 

is  a requirement  for  the  preparation  of  highly  accurate  real  world  terrain 
data  for  normal  applications  was  not  resolved.  However,  cn  the  presump- 
tion that  specific  model  applications  e.yist  for  which  theoretical  terrain 
is  not  suitable,  and  in  view  of  the  fact  that  current  model  application 
practices  assume  that  terrain  data  bases  are  developed  for  general  (i.e., 
not  scenario  specific)  applications  and  these  data  are  therefore  used 
time  and  again,  then  several  observations  concerning  preparation  of  ter- 
rain data  are  in  order. 

b.  Level  of  Effort.  The  preparation  of  highly  accurate  terrain  data 
for  these  modelT  is  a laborious  and  tine  consuming  task.  The  general 
impression  persists  that  DYNTACS  uses  "digitized  terrain"  and  that  the 
preparation  of  DYNTACS  terrain  data  is  not  the  ma.ior  undertaking  that  it 
is  for  the  other  two  models.  Digitized  elevation  data  are  used  in  DYNTACS 
but  all  other  terrain  inputs  (of  which  there  are  a considerable  number) 
are  prepared  by  hand.  About  2 man-months  are  required  to  prepare  terrain 
by  personnel  possessing  a reasonable  understanding  of  hcM  these  data  are 
to  be  used  in  the  model  and  possessing  the  ability  to  read  both  military 
mapsheets  and  aerial  photographs  with  facility. 

c.  Lead  Time.  The  data  required  for  preparation  of  highly  accurate 
terrain  inputs^rnclu  ie  military  mapsheets,  aerial  photographs,  digitized 
elevation  tapes  (essential  for  DYNTACS,  useful  for  CARMONETTE)  and  soil, 
terrain  roughness,  and  vegetation  overlays.  In  addition  one  or  more  on- 
site inspections  of  the  actual  terrain  is  desirable  during  the  preparation 
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process.  With  (normally)  the  single  exception  of  military  mapsheets, 
the  procurement  of  all  of  these  items  requires  considerable  lead  time 
so  model  applications  requiring  terrain  data  preparation  must  be  planned 
for  several  months  in  advance.  It  may  be  worth  noting  that  mapsheets  of 
a scale  large  enough  for  extracting  elevations  and  their  locations  by 
hand  (1/25,000  or  larger)  are  becoming  increasing  difficult  to  obtain. 

d.  Accuracy  of  Elevation  Data.  The  accuracy  of  elevations  used  in 
calculations  during  a typical  mode^  run  is  determined  by  the  accuracy  of 
the  sources  from  which  terrain  inputs  are  prepared,  the  accuracy  inherent 
in  the  procedures  for  preparing  data  from  these  sources  for  model  use, 
and  the  accuracy  inherent  in  the  methodology  for  selecting  and  applying 
these  data  in  model  computations. 

(1)  Accuracy  of  source  data.  In  contrast  to  a preconception 
hold  by  the  study  team,  the  team  learned  that  digitized  elevation  data 
are  normally  developed  from  standard  Army  mapsheets  with  elevation  data 
between  contour  intervals  derived  through  interpolation.  Thus,  the  major 
differences  in  accuracy  between  digitized  and  hand-prepared  elevations 
derive  solely  from  differences  in  the  accuracy  with  which  these  data  are 
e.xtracted  from  the  mapsheets  and  the  accuracy  of  the  respective  interpola- 
tion methods. 

(2)  Processing  accuracy.  The  accuracy  with  which  these  source 
data  are  prepared  for  use  in  the  models  is  also  important.  Both  IDA  and 
CARMONETTE  introduce  human  error  and  subjectivity  into  this  process,  and 
the  procedures  for  these  two  models  can  introduce  actual  mistakes  into 
the  data  as  well  as  minor  variations.  DYMTACS,  on  the  other  hand,  pro- 
vides for  the  automated  preparation  of  these  data,  thus  eliminating  most 
subjectivity  and  human  error  from  the  process.  It  appears,  however,  that 
in  this  case  the  cure  can  be  worse  than  the  disease.  In  a typical  DYNTACS 
application,  the  preparation  of  elevation  data  can  involve  a sequence  of 
up  to  three  major  adjustments  through  interpolation  to  the  entire  eleva- 
tion data  base  (reference  7).  While  two  of  these  interpolations  can  be 
avoided  entirely  (provided  that  the  user  is  (•’ware  of  the  problem)  and 

the  third  (and  probably  least  serious)  interpolation  could  also  be  elimi- 
nated at  some  cost,  nowhere  in  the  model  literature  is  the  model  user 
warned  of  this  problem.  Potentially,  the  error  introduced  in  the  auto- 
mated processing  of  elevations  for  DYllTACS  could  be  much  worse  than 
those  for  the  other  two  models. 

e.  Quali^  Assurance.  Suitable  procedures  for  verifying  the  accu- 
racy of  tei ' lin  inputs  exist  only  for  the  DYNTACS  model.  While  mistakes 
made  in  extracting,  recording,  or  keypunching  terrain  data  are  likely  to 
go  undetected  in  lUA  and  CARMONETTE,  a number  of  computer  programs  have 
been  developed  for  DYNTACS  that  produce  graphic  representations  (contour 
maps,  shaded  vegetation  areas,  etc)  of  the  terrain  inputs,  and  these 
graphics  make  the  detection  of  most  types  of  ma^or  errors  highly  likely. 

The  US  Am\y  Concepts  Analysis  Agency  has  recently  completed  work  on  adapting 
some  of  these  verification  procedures  for  use  with  CARMONETTE. 
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E-3.  LESSONS  IN  MODEL  APPLICATION.  Three  specific  lessons  related  to 
application  of  the  three  models  are  notable. 

a.  General  Purpose  Terrain.  Even  though  the  intention  may  have  been 
to  c'evelop  terrain  data  bases  of  general  usefulness,  tv-crain  data  bases 
have  in  the  past  typically  been  developed  for  particular  model  applica- 
tions. Because  of  the  effort  required  in  developing  data  for  new  terrain 
areas,  these  terrain  data  have  been  used  in  one  model  application  after 
another.  The  importance  of  these  two  observations  taken  together  is 
illustrated  by  the  fact  that,  in  all  three  models,  line  of  sight  cannot 
exist  to  weapons  located  in  certain  types  of  vegetation  even  though  these 
weapons  may  be  antitank  missile  weapons  emplaced  specifically  for  long 
range  observation  and  fires.  In  order  to  avoid  this  obvious  mistake,  the 
preparer  of  terrain  data  must  know  during  data  preparation  the  general 
area  in  which  these  weapons  are  to  be  emplaced.  Tnus,  the  concept  of 
general  purpose  terrain  data  bases  is  somewhat  misleading.  In  every 
model  application,  terrain  data  must  be  carefully  reviewed,  by  knowledge- 
able model  experts,  to  determine  whether  revisions  to  these  data  are 
required  by  the  scenario  to  be  played  (with  particular  emphasis  on  defen- 
sive areas). 

b.  Model  Scenario  Development.  During  the  intervisibi lity  study  it 
was  learned  that  establishing  defender  weapon  locations  in  the  models  by 
(mathematically)  converting  UTM  coordinates  to  model  coordinates  often 
did  not  produce  results  desirable  for  model  applications.  In  some  cases, 
the  geometric  model  representations  of  terrain  surface  and  vegetation 
precluded  model  weapons  from  realizing  the  good  observation  and  fields 

of  fire  enjoyed  by  their  field  experiment  counterparts.  This  can  often 
be  corrected  by  changing  slightly  the  location  of  defender  weapons  in 
the  models.  A computer  program  is  available  for  DYNTACS  that  computes 
and  displays  all  areas  of  the  battlefield  that  can  be  observed  from  a 
specific  defender  (or  any  other)  location.  Both  IDA  and  CARMONETTE  also 
provide  some  information  on  LOS.  The  lesson  is,  of  course,  that  some 
capability  exists  within  each  model  to  check  the  amounts  of  intervisibility 
produced  for  specific  battlefield  locations  and  these  capabilities  should 
be  exercised  so  that  weapon  locations  in  the  models  are  established  based 
upon  the  extent  to  which  their  desired  intervisibility  characteristics 
are  actually  achieved.  However,  one  cannot  escape  the  observation  that 
in  doing  so,  the  model  user  makes  the  final  determination  of  the  amount 
of  intervisibility  to  be  achieved  from  each  position.  Whether  the  models 
can  be  used  as  predictive  tools  in  determining  overall  visibility  levels 
from  individual  positions  thus  remains  an  open  question. 

E-4.  LESSONS  IN  MODEL  VERIFICATION.  Two  principal  lessons  in  model 
verification  stand  out. 

a.  Resources  Required  As  expected,  the  work  described  in  this  re- 
port absbVbeJ  the  considerable  technical  resources  shown  in  table  E-1. 

These  figures  include  40  man-weeks  support  provided  by  the  Concepts 
Analysis  Agency. 
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Table  E-1.  Professional  Manpower  Expenditures  (Man-Weeks) 


- 

Qualification 

Major  Task 

OR 

Analyst 

Computer 

Specialist 

All 

Approach  Formulation 

10 

— 

10 

Baseline  Definition 

28 

35 

63 

Methodology  Development 

29 

14 

43 

Model  Preparation/ 
Operation 

71 

73 

144 

Comparison  Analysis 

30 

12 

42 

All  Tasks 

168 

134 

302 

b.  Simultaneity  of  Experimentation.  An  ideal  situation  for  purposes 
of  (Tiodel  validation  woul^be'lTrriuiltaneous  exercise  of  the  model  and  field 
experimentation.  This  would  permit  discrepancies  between  the  field  and 
the  model  to  be  fully  understood,  explored,  and,  hopefully,  resolved  by 
return  to  the  field  and  in-depth  study  as  required.  Such  an  approach 
would  require  commitment  of  experimental  resources  to  a flexible  schedule 
paced  by  the  validation. 

5.  SUMMARY.  A number  of  useful  lessons  related  to  preparation,  appli- 
cation, and  verification  of  the  three  models  were  identified  during  the 
conduct  of  this  work.  Those  believed  to  be  of  general  interest  have 
been  reported. 
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The  TETAM  Model  Verification  studv  is  reported  in  three  volumes  describina 
the  validation  of  three  hi  oh  resolution  co.  ibat  simulation  models  (DYNTACS, 
lUA,  and  CAPMONETTE)  usinn  field  data  collected  by  US  Army  Combat  Developments 
Experimentation  Command  durinn  Experiment  11. B.  Volumes  I and  II  contain  an 
intervisibility  study  describino  the  abilities  of  the  DYNTACS,  Ilia,  and  CAR- 
MONETTE  terrain  processors  to  Predict  line-of-siaht  occurrences  between  tanks 
and  antitank  missile  positions.  Volume  III  contains  a validation  study  of 
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20.  the  enoaoement  processors  of  OYMTAC*;  and  IIJA.  The  results  from  the 
simulation  models  In  terms  of  firinos,  enoanements,  and  losses  between  tank  and 
antitank  as  compared  with  the  field  data  collected  durinn  the  free  play  battles 
of  Field  Experiment  11.8  are  found  In  Volume  111. 
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